-- Logs begin at Fri 2022-09-09 10:29:39 UTC, end at Fri 2022-09-09 11:35:24 UTC. -- Sep 09 11:06:48.758943 dv-osbrick-856711-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 11:06:48.768339 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 11:06:48 2022] *** Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: nodename: dv-osbrick-856711-1-ceph Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: machine: x86_64 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: clock source: unix Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: pcre jit disabled Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: detected number of CPU cores: 4 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: current working directory: / Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: detected binary path: /usr/bin/uwsgi-core Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: your processes number limit is 47680 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: your memory page size is 4096 bytes Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: detected max file descriptor number: 2048 Sep 09 11:06:48.770407 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: lock engine: pthread robust mutexes Sep 09 11:06:48.771152 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: thunder lock: enabled Sep 09 11:06:48.771152 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 11:06:48.771152 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 11:06:48.814998 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: Python main interpreter initialized at 0x55a5867239c0 Sep 09 11:06:48.814998 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: python threads support enabled Sep 09 11:06:48.814998 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: your server socket listen backlog is limited to 100 connections Sep 09 11:06:48.814998 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: your mercy for graceful operations on workers is 90 seconds Sep 09 11:06:48.815376 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 11:06:48.815452 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: *** Operational MODE: preforking *** Sep 09 11:06:48.815671 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: *** uWSGI is running in multiple interpreter mode *** Sep 09 11:06:48.815671 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: spawned uWSGI master process (pid: 88282) Sep 09 11:06:48.815878 dv-osbrick-856711-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 09 11:06:48.817543 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: spawned uWSGI worker 1 (pid: 88293, cores: 1) Sep 09 11:06:48.817543 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: spawned uWSGI worker 2 (pid: 88294, cores: 1) Sep 09 11:06:48.817543 dv-osbrick-856711-1-ceph devstack@keystone.service[88282]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 11:06:53.490402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:06:53.490402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: from cryptography.utils import int_from_bytes Sep 09 11:06:53.491187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:06:53.491187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: from cryptography.utils import int_from_bytes Sep 09 11:06:53.491622 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:06:53.491622 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: from cryptography.utils import int_from_bytes Sep 09 11:06:53.491757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:06:53.491757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: from cryptography.utils import int_from_bytes Sep 09 11:06:53.544754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:06:53.544954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:06:53.545122 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] command line args: [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:06:53.545310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:06:53.545432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:06:53.545513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:06:53.545589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ================================================================================ {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:06:53.545691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] command line args: [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:06:53.545799 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] admin_token = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.545959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:06:53.546042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] config_dir = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ================================================================================ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:06:53.546230 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] config_source = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] admin_token = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546608 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] debug = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_dir = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.546790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] config_source = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548273 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] debug = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548331 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_config_append = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548826 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548947 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_dir = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.548947 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_file = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_config_append = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_dir = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.549961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550473 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550567 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.550946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551196 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.551907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552020 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552614 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552817 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] publish_errors = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.552926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553387 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553674 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] publish_errors = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.553902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] standard_threads = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.554924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] use_journal = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555315 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] standard_threads = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] use_json = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] use_stderr = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] use_syslog = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.555962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556084 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_journal = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556424 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.556542 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_json = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556661 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.556782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_stderr = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.556782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] use_syslog = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.557003 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.557148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:06:53.557763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.557877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.557999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558361 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558488 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.558895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559083 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559178 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559678 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559833 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.559972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560621 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.560868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561101 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561176 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561427 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561596 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561684 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561840 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.561923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562320 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.562949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563191 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563544 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.563890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564003 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564513 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.564969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565082 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565557 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.565911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566430 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.566975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567094 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567438 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567552 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567878 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.567996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568108 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568342 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.568908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569021 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569132 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.569925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570180 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570180 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570423 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.570651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571346 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.571914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572037 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572403 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.572897 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573019 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573595 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573717 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.573838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.574906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575030 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575153 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575387 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.575974 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576777 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.576889 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577002 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577568 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577682 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.577931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578743 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.578857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579183 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579554 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579783 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.579896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580487 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.580936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581528 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.581981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582216 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.external = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.582890 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583254 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.external = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.password = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] auth.token = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583830 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.583953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584185 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.password = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584414 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] auth.token = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.584925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585040 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585156 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585852 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.585975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.586936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587279 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587635 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.587977 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.588907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589481 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589841 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.589961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590077 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.590926 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591048 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591285 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591401 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591516 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591638 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.591989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592409 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592528 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.592993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593116 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593460 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.593926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594608 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.594958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595538 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595654 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595768 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.595882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596105 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596220 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596684 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.596916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597366 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.597944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598188 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598433 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598433 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598781 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.598898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599360 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599483 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599836 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.599951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600747 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.600986 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601099 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601426 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601552 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.601895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602132 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602248 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.602886 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603356 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603586 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.603826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.604448 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.604563 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.604714 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.604830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.604953 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605765 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605879 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.605993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606482 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.606938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.607990 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.608940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609297 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609526 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609754 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.609992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610531 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.610920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611149 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611852 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.611965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612087 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.612899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613013 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613127 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613241 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613354 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613706 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613819 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.613933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614283 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.614918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615149 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615494 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.615920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616147 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] role.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] role.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.616963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617422 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.617890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618607 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.618950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.619075 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.619193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.619308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.619422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.619568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.620776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621118 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621365 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621592 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621829 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.621944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622567 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.622908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623725 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.623954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.624905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.625964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626079 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626438 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626682 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626797 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.626911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627139 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627814 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.627936 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628052 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.628853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629075 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.connection = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629199 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629315 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629315 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629528 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629881 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.629994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.630961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631420 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.631902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632819 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.632934 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633048 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633285 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:06:53.633518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:06:53.633518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:06:53.661357 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.661589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.661823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.662368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.662776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.663018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.671288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.672270 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.700363 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.700540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.700715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.700951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.756386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.756640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.806539 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.806725 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.806866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.806946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.875393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.875621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.875843 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.875941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876144 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.876965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.899785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900101 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900327 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.900683 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901634 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.901843 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.912806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.913526 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.925897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926426 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926574 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926671 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.926875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.927645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 11:06:53.944067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.944277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:06:53.944509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.944628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.944709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:06:53.944831 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:06:53.945053 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.945141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.945257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 11:06:53.945361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.945535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.945614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.946068 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.946163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.946327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.946610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.955833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956071 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956223 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956343 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.956777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.957070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.964176 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.964620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.967362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.967362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.969418 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.969565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.969644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.969765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.969842 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.969959 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970478 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970557 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970694 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970772 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970889 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.970965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.971081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.971166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.971239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.971239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.992842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.992972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.994310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.994970 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.995161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.995243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:53.999740 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:53.999830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.000027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.000109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.001992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.002079 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.008440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.008538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.008734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.008816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.012821 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.012910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.013114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.013196 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.013400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.013479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.013795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.013877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014153 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014661 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.014939 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.015020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.031043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.031198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.031339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.031456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.035210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.035449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.038322 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.038649 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.038763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.039067 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.043559 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.043961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.047328 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.047564 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.050466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.050698 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.050790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051100 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051287 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.051992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.052080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.052276 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.068413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.068600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.068705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.068881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.068964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.069149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.069232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.069410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.078442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.079927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.080095 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.081597 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.081681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.081907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.083520 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.083796 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.084570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.084865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.085151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.085437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.085734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.086447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.086744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.087029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.087316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.087607 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.097107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.097403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.097689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.097975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.098274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.098580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.098857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.098944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.099218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.099501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.099780 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.100074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.100352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.100626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.114317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.116238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.117386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.119279 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.120854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.122309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.122716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.123797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.124084 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.124186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.124401 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.125602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.125886 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.126195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.131049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.132590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.132801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.134338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.136198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.136503 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.136792 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.137068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.137899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.138222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.138534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.138817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.145236 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.145542 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.145827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.147189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.147492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.147779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.154137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.154469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.154767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.155047 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.155335 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.155619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.155895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 11:06:54.156165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.156913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157199 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157482 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.157848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.158028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.158315 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.158624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.158910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.159175 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.159443 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.159710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 11:06:54.191992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5867239c0 pid: 88293 (default app) Sep 09 11:06:54.195392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5867239c0 pid: 88294 (default app) Sep 09 11:06:54.195992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c5a4-b975-4df3-aef5-22c1df8b3300 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:06:54.196294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c5a4-b975-4df3-aef5-22c1df8b3300 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:06:54.196578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4c5a4-b975-4df3-aef5-22c1df8b3300 None None] PATH_INFO: `/v3` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:06:54.201683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Fri Sep 9 11:06:54 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:01.590887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:01.591399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:01.591481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:01.595875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:01.601410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:01.602005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:01.602005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:01.677477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: INFO dbcounter [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] Registered counter for database keystone Sep 09 11:07:01.698872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG oslo_db.sqlalchemy.engines [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:07:01.705168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writer thread running {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:07:01.883721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG passlib.handlers.bcrypt [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88293) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:07:01.884125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG passlib.handlers.bcrypt [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88293) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:07:01.943245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:01.944845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:02.078019 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:07:02.625303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.701992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: INFO dbcounter [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] Registered counter for database keystone Sep 09 11:07:02.723551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG oslo_db.sqlalchemy.engines [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:07:02.730586 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writer thread running {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:07:02.848887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bb69e-a9a7-4d2a-9a75-a47c8c1eed0e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.853793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.854441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.854723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.854995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.863725 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:02.914424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:07:02.914762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c102-58e6-4baa-86bc-8462408c9079 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:02.925608 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 11:07:02.931655 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:02.949031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105e064-b3ff-4fec-9391-62b8cc19caf9 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:02.954566 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:02.955625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:02.955906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:02.956186 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] PATH_INFO: `/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:02.960102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] RBAC: Authorizing `identity:get_project(project_id=aa345ead696a4e8d96d7636f92ce2f5c)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:03.009901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 11:07:03.010243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124c6a-7401-4820-b790-fc65c29ba6cf admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:03.014880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Fri Sep 9 11:07:02 2022] GET /identity/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:05.396966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018fc4-5b27-4468-8f59-5a7395a4ede3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.397544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018fc4-5b27-4468-8f59-5a7395a4ede3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.397544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c018fc4-5b27-4468-8f59-5a7395a4ede3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.402107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:05.407811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.408271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.408373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.429221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:05.430829 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:05.439759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 11:07:05.761397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018fc4-5b27-4468-8f59-5a7395a4ede3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:05.773421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c018fc4-5b27-4468-8f59-5a7395a4ede3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:05.777731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:05.778324 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.778645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.778915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.786533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:05.788299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862891b1-bddc-48a5-86fc-0ec009b1c7a7 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:05.797504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Fri Sep 9 11:07:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 11:07:05.802917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:05.812542 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01a526-43ea-409a-bcaa-9cb22ec74548 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:05.816815 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:05.817428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:05.817703 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:05.817971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:05.819318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:05.821336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12190493-232c-418a-949d-2514c6cdb9f1 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:05.822899 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Fri Sep 9 11:07:05 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:08.279667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252919-f231-4459-9c0d-2f09ca55dff2 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.280214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252919-f231-4459-9c0d-2f09ca55dff2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.280214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec252919-f231-4459-9c0d-2f09ca55dff2 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.281544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:08.286974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.287434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.287525 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.305460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:08.307217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:08.353201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba753ea-a681-4426-89e2-4bcb714444b4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.353513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba753ea-a681-4426-89e2-4bcb714444b4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.353790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba753ea-a681-4426-89e2-4bcb714444b4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.355151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:08.360319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.360600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.360871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.393216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:08.403593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG passlib.handlers.bcrypt [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88294) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 11:07:08.403990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG passlib.handlers.bcrypt [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88294) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 11:07:08.453879 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:08.455515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:08.554807 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:08.710623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:08.845281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:08.873263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:08.928062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d8aeb-5c2f-4f7c-a38a-652fe7b24d6e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:08.963254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:08.963892 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:08.964172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:08.964445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:08.975255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255558-460f-4a2d-88c3-3d5c2e85c636 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:08.975651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:08.977460 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:08.984551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:08.985484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:08.986308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:08.991865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.013568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.014508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.014785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.015053 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.076156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.083517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.085016 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.094494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a5259-eea6-4502-9286-68bf16bd4e46 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.128189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.128723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.128997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.129264 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.129923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:09.130237 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.131623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.143950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:09.149548 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.182084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:07:09.187692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.190380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.253782 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f7d05-6fb0-479f-9aca-1750e689ae3f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.284091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212153-cd4a-4f7d-b49e-7f26f78c18e4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.286120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.286776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.287051 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.287523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.288428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.289863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.291946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:09.297299 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.312421 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.320876 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.321756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.322036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.322303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.340693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.342152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:07:09.362790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:09.363713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:07:09.364514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:07:09.364514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:07:09.364514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:09.364514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:09.370205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.400836 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a8907-d559-4fc9-ac97-980c68d543db None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.442109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.442816 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.443096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.443366 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.444604 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.446378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.448257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:09.454008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:09.536847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.539494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:09.560251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6ed0a-b09e-4ecb-9f3e-0f1d47589bad None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.582505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07063b96-4d58-4c3b-8be3-fbfe3a78efaf None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:09.595674 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.596286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.596570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.596834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.597551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.domain.id=default, user.id=53667c405cc947ceb4171bc3579d9405) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:09.597853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.599313 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f5026-669d-4fbc-b7eb-eb472096f2f7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.606018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/role_assignments?user.id=53667c405cc947ceb4171bc3579d9405&scope.domain.id=default&role.id=812192d969e9436d9845f219dd311628 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:09.615743 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:09.616375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:09.616649 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:09.616914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:09.617571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:09.617868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:09.619868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145e813-0cb7-44ae-a6ec-83ee66f662b2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:09.640413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:12.208602 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be38d2-15eb-41f1-a949-73020abd6b9f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.209608 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be38d2-15eb-41f1-a949-73020abd6b9f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.210120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be38d2-15eb-41f1-a949-73020abd6b9f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.212276 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:12.217911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054d5e-2c76-4cf0-b56f-419719c5b752 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.218812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054d5e-2c76-4cf0-b56f-419719c5b752 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.219281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2054d5e-2c76-4cf0-b56f-419719c5b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.248394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c2054d5e-2c76-4cf0-b56f-419719c5b752 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:12.249926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c2054d5e-2c76-4cf0-b56f-419719c5b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:12.343731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:12.785712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be38d2-15eb-41f1-a949-73020abd6b9f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:12.875621 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb7fa-a76b-4d64-84a3-b5413013dd65 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.876165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb7fa-a76b-4d64-84a3-b5413013dd65 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.876583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecb7fa-a76b-4d64-84a3-b5413013dd65 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.878082 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:12.883762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959b5c-ddc7-4291-8858-4b1de2fd64ab None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:12.884247 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959b5c-ddc7-4291-8858-4b1de2fd64ab None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:12.884667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959b5c-ddc7-4291-8858-4b1de2fd64ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:12.917179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e1959b5c-ddc7-4291-8858-4b1de2fd64ab None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:12.920116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e1959b5c-ddc7-4291-8858-4b1de2fd64ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:12.972646 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be38d2-15eb-41f1-a949-73020abd6b9f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:13.019168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:13.049326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:13.050220 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.050667 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.051083 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.069025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:13.073511 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a117f9-92ba-4fdb-8f14-47dfd1561724 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.073991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a117f9-92ba-4fdb-8f14-47dfd1561724 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.075452 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:13.075633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a117f9-92ba-4fdb-8f14-47dfd1561724 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.077063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-0a732b44-f2d5-42b3-8ee2-272fce8280fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:13.082160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:13.083263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:13.084217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:13.086123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:13.092005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a117f9-92ba-4fdb-8f14-47dfd1561724 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.103331 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.103866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.104284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.122405 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:13.145335 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:13.147952 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:13.303257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a117f9-92ba-4fdb-8f14-47dfd1561724 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:13.335685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:13.372520 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:13.373142 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.373420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.373693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.374383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:13.374693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:13.376085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ebcbc-f44a-42af-9c55-a1c41f7932fa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:13.399787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 15/29] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:13.405310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.426394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06f619-9cf4-45e4-b45e-00325285af00 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.426677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06f619-9cf4-45e4-b45e-00325285af00 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.426950 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06f619-9cf4-45e4-b45e-00325285af00 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.428413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:13.435675 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.435958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.436234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.471450 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:13.472676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:13.546736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:13.632750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89137e0d-b84c-4a28-be7d-ab7a18abea72 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:13.636805 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 17/31] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:13.637385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.722440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:13.723111 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.723390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.723664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.726032 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:13.727724 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:13.729732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 15/32] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:13 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:13.752578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.755464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:13.828384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22d38a-89b1-4e4e-ac11-10b22ebad4bb None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:13.896205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:13.896769 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:13.897050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:13.897320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:13.919676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:13.921165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:07:13.960261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:13.961195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:07:13.962049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:07:13.962049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:07:13.962049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:13.962049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 18/33] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:13.963206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:13.973239 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dc66a-02f3-44b5-99ad-56b1ae1d89db None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.018791 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.044717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.045348 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.045631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.045903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.047071 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.048519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.050432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 16/34] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:14.051283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.117301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326bee-c1a4-4ef7-84c2-9a4096361a57 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.124827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.157437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.158270 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.158619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f566b-b69b-48b9-816c-f51af3af0ca4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.158890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.159321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.160405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.162911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.198212 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.199439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.199439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.199439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.200036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:14.200380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.201866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.221073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 17/35] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:14.223018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.309502 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 19/36] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 9 11:07:13 2022] POST /identity/v3/roles => generated 219 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:14.311673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.358227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32be5e-139a-4d02-b41a-b38c3c30d7c8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.393518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.400717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.401347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.401631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.401907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.402634 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.404074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca9ce8-0360-4a07-9f4e-da58a4cd3936 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.410638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.435902 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319614a0-ed61-436f-8845-4a9ce83fb11b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.475669 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.476355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.476636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.476918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] PATH_INFO: `/v3/domains/default/users/53667c405cc947ceb4171bc3579d9405/roles/812192d969e9436d9845f219dd311628` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.480188 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=53667c405cc947ceb4171bc3579d9405, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.481791 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13deced4-5198-480b-8e69-b5ba217c4ab3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.501778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1361 bytes} [Fri Sep 9 11:07:14 2022] PUT /identity/v3/domains/default/users/53667c405cc947ceb4171bc3579d9405/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:14.503632 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b5cf-f511-4b01-abd7-d2532f918846 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.504139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b5cf-f511-4b01-abd7-d2532f918846 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.504622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6b5cf-f511-4b01-abd7-d2532f918846 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.506279 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 21/38] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:14.507423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6b5cf-f511-4b01-abd7-d2532f918846 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:14.558328 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 18/39] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 9 11:07:14 2022] POST /identity/v3/roles => generated 225 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:14.559987 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034ca8d-e61e-4ac1-904e-75a98d934d0a None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.560286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034ca8d-e61e-4ac1-904e-75a98d934d0a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.560567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034ca8d-e61e-4ac1-904e-75a98d934d0a None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.562040 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 19/40] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:14.563103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef59ff-b6cf-4497-8055-25756251845e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.563363 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef59ff-b6cf-4497-8055-25756251845e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.563644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef59ff-b6cf-4497-8055-25756251845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.594626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ceef59ff-b6cf-4497-8055-25756251845e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:14.596570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ceef59ff-b6cf-4497-8055-25756251845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:14.690479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6b5cf-f511-4b01-abd7-d2532f918846 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:14.690870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:14.692598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.693092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.693367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.735664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:14.736914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:14.742302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:14.743638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:14.744150 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:14.744679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:14.745570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:14.748301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:14.766824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:14.798133 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:07:14 2022] POST /identity/v3/projects => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:14.860845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:15.077513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:15.188706 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:15.193874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21413c-361f-4d3c-acc3-768986808f97 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:15.234415 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:15.235399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:15.235686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:15.235957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:15.236619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:15.237996 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:15.238848 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:15.262549 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 9 11:07:15 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:15.301243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b3c93-5124-4026-b9db-529c44c662f9 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:15.339888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:15.340453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:15.340738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:15.341013 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:15.342182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:15.343843 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712e35b-fe9b-4922-b683-b25211025239 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:15.345740 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 22/45] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:15.351525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:15.411825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:15.465892 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c5682-6a98-4e95-9074-13ad47069ef2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:15.501135 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:15.501751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:15.502028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:15.502298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:15.502983 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:15.504449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824d821-1006-4fa1-9541-f77078c4b282 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:15.531869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:07:15 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:07:17.096027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65576-e7ef-48c1-9dd4-125d773f3bfe None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.096571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65576-e7ef-48c1-9dd4-125d773f3bfe None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.096571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba65576-e7ef-48c1-9dd4-125d773f3bfe None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.097909 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 23/47] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:17.103703 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.104107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.104261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.123968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:17.125495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:17.190871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:17.507651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba65576-e7ef-48c1-9dd4-125d773f3bfe None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.609627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba65576-e7ef-48c1-9dd4-125d773f3bfe None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.627757 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:17.645217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.645845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.646128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.646435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.656935 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:17.661735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:17.662648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:17.663398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 24/49] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:17.668773 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.702403 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:17.766533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241281-f2ec-4e36-bd17-30ed92471059 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.802775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.803385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.803667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.803939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.804599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:17.804952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:17.806328 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7056d-f163-4177-bc29-029e30b9330d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:17.814357 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 26/50] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:17.820914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:17.934605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a191-3e65-419b-958f-5c7351696cd5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.934884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a191-3e65-419b-958f-5c7351696cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.935161 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39a191-3e65-419b-958f-5c7351696cd5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.936547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 27/51] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:17.938105 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68483c43-4380-4434-8e93-91c7029d5456 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:17.942025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.942305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.942604 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.960772 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:17.962469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:17.975545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:17.976164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:17.976449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:17.977297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:17.978444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:17.979888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:17.981469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:17.986825 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:18.028605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 28/53] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:18.032503 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:18.087450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8b91e-7cb4-4347-ab08-cba74bce781d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:18.120165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:18.120812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:18.121074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:18.121345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:18.122509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:18.123959 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:18.125693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 26/54] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:18.131473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:18.158080 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:18.230169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415453b-85cc-454e-b927-15e78c5bd236 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:18.262928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:18.263535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:18.263817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:18.264088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:18.264808 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.domain.id=default, user.id=53667c405cc947ceb4171bc3579d9405) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:18.265114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:18.266573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:18.274256 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1322 bytes} [Fri Sep 9 11:07:18 2022] GET /identity/v3/role_assignments?user.id=53667c405cc947ceb4171bc3579d9405&scope.domain.id=default&role.id=812192d969e9436d9845f219dd311628 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:18.360357 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:18.473747 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169167f-d0fb-41c0-bcd3-42f192892677 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:18.488923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:18.510433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:18.511069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:18.511356 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:18.511628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:18.512734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:18.514193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5500144-3b7d-47e4-9caf-70eaa0c5655e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:18.515948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 27/56] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:18.521384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:18.611772 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:18.621736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf928ad-5405-4a23-8446-17d11c9093cd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:18.653516 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:18.654112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:18.654414 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:18.654688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:18.655320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:18.656749 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fbe1e-ec9d-49bc-a944-1dfdbf4c127e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:18.682233 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 30/57] 10.222.0.25 () {60 vars in 1140 bytes} [Fri Sep 9 11:07:18 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:21.059208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6feca-bf02-4b9d-b432-124091785ba3 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:21.059761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6feca-bf02-4b9d-b432-124091785ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:21.059761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6feca-bf02-4b9d-b432-124091785ba3 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:21.061079 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:21.066525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:21.066967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:21.067063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:21.084863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:21.086563 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:21.152440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:21.476613 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6feca-bf02-4b9d-b432-124091785ba3 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:21.600118 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6feca-bf02-4b9d-b432-124091785ba3 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:21.637647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:21.638583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:21.638917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:21.639195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:21.640318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:21.641759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72781-6963-448f-8dba-ca21179573c7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:21.643342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:21.653225 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:21.727219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:21.756507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06390-8d4e-4c76-9cf9-45163b53d5e0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:21.790201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:21.790833 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:21.791113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:21.791385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:21.792064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:21.793495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bea18-3664-4a09-8cad-83cd9bd8c8d6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:21.819430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:21 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:25.470974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df52cd-00fb-462c-a30a-a5927c573772 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:25.472319 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df52cd-00fb-462c-a30a-a5927c573772 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:25.473017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df52cd-00fb-462c-a30a-a5927c573772 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:25.475710 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:25.481461 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def676eb-1506-4fc1-b067-25aa037ed7de None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:25.482106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def676eb-1506-4fc1-b067-25aa037ed7de None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:25.482106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def676eb-1506-4fc1-b067-25aa037ed7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:25.512504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-def676eb-1506-4fc1-b067-25aa037ed7de None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:25.513716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-def676eb-1506-4fc1-b067-25aa037ed7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:25.610116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 33/63] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:25.702821 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30b12-99b6-48e1-ae34-a7a7f8d43ee3 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:25.703688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30b12-99b6-48e1-ae34-a7a7f8d43ee3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:25.704389 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f30b12-99b6-48e1-ae34-a7a7f8d43ee3 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:25.706938 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 31/64] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:25.713167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecec8c-a371-4125-87d3-191fed7570f5 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:25.713457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecec8c-a371-4125-87d3-191fed7570f5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:25.713911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecec8c-a371-4125-87d3-191fed7570f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:25.743392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b3ecec8c-a371-4125-87d3-191fed7570f5 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:25.744852 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b3ecec8c-a371-4125-87d3-191fed7570f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:25.809646 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:25.828802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 34/65] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:26.094646 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30b12-99b6-48e1-ae34-a7a7f8d43ee3 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.212252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:26.238627 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec51-2bd2-4005-b371-729d38c50a19 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.239259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec51-2bd2-4005-b371-729d38c50a19 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.239763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ec51-2bd2-4005-b371-729d38c50a19 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.241317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 35/66] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:26.246553 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.247101 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.247585 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.291116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:26.299734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:26.320917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f30b12-99b6-48e1-ae34-a7a7f8d43ee3 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.358190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.358826 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.359108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.359436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.371665 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:26.377314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 36/67] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:26.378432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:26.383211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:26.384042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:26.384808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 32/68] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:26.390322 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.528246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8416f03-079d-4c80-8db7-cea11c96b63c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.541545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307bbc-7c7b-49c8-9425-6ed35c7aec0b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.551107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:26.552789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:26.572054 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.572696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.572981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.573257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.583214 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.583835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.584124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.584399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.585066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:26.585181 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:26.585997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:26.587422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd7335-998c-40ce-a162-4d6fff3fe0f0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-905f0e22-4f13-48eb-b2f1-b72f2828761c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:26.593020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:26.593884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:26.594677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 37/69] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:26.595994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c9ac-0158-4b58-8a2e-52610b410d9f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.595994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c9ac-0158-4b58-8a2e-52610b410d9f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.595994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0c9ac-0158-4b58-8a2e-52610b410d9f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.597258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 38/70] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:26.598142 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9730-127c-4713-9fe2-bac67df5afb4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.598534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9730-127c-4713-9fe2-bac67df5afb4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.599069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b9730-127c-4713-9fe2-bac67df5afb4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.600444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 39/71] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:26.601389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b9730-127c-4713-9fe2-bac67df5afb4 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.601871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 33/72] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:26.603736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e162c6-63d0-4a66-9483-823a0b17afbe None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.604032 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e162c6-63d0-4a66-9483-823a0b17afbe None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.604314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e162c6-63d0-4a66-9483-823a0b17afbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.623184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e3e162c6-63d0-4a66-9483-823a0b17afbe None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:26.624308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e3e162c6-63d0-4a66-9483-823a0b17afbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:26.693039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 34/73] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:26.699893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.700184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.700468 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.719468 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:26.720933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:26.721571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b9730-127c-4713-9fe2-bac67df5afb4 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.759723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.760687 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.760972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.761309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.761980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:26.762316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:26.763741 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:26.774398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 40/74] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:26.774398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.796639 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 35/75] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:26.797763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.820236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:26.844218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:26.892193 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04775c79-2cc3-442c-ad43-80d650f1c573 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.926404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8a05c-7fb4-4806-8ada-742ac4b6fab0 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:26.928718 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.929625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.930109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.930652 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.946909 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:26.948668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:26.950603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 41/76] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:26.951587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:26.975210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:26.976944 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:26.977812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:26.978641 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:26.993476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:26.998466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:26.999376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:27.000300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 36/77] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:27.000978 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.075579 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.080596 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5ac3c-8647-4773-8b87-351ae4a7f342 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.103589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.113422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe68137-3d21-4b24-8ee2-8fd5080e0d36 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.119280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.119929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.120240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.120519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.121678 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.123170 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.125489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.126655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.153386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.154216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.154661 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.155188 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.226976 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.228716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.230449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53dc0a-3c7a-49c6-8efb-635b1f56f452 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.267947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.268573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.268856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.269136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.269804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:27.270110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.271544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.280529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 43/79] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.281357 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.309377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.325746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.336240 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:27.337061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.383789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b93a65-4a2a-408d-8d4b-a9df4932cb51 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.416665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.417206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.417495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.417765 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.418904 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.420340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.421882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 44/81] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.422665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.437372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0c1-ec04-4a57-828c-6cc20375859e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.471883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be45e-1947-4416-91b5-55bba21185db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.472489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be45e-1947-4416-91b5-55bba21185db None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.472765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be45e-1947-4416-91b5-55bba21185db None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.473036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375be45e-1947-4416-91b5-55bba21185db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.515893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.522255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832a5c9-690e-401a-b0e5-e52d7e47aefe None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.536094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.546249 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be45e-1947-4416-91b5-55bba21185db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.547773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375be45e-1947-4416-91b5-55bba21185db None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.559411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.560040 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.560317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.560587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.571255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:27.576455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:27.577303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 45/82] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:27.578918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.648174 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 38/83] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:27.648933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be45e-1947-4416-91b5-55bba21185db None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.684139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5515b1-ad0d-4280-a14c-5167379f4838 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.716791 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.717415 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.717695 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.717966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.719119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.720560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.722111 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 46/84] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.722877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.741730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.748469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.750906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375be45e-1947-4416-91b5-55bba21185db None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.784400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.785026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.785312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.785577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.786702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.788194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.790454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 39/85] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.791137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.824071 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737aad91-d329-46e4-983a-0696b8950708 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.857776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.858409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.858691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.858967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.859611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.861055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.882514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 47/86] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:27 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:27.882514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.906510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd324c43-6d3c-4771-adc4-0c173ea2cd9f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:27.949472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:27.950019 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:27.950300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:27.950609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:27.951303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:27.951607 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:27.953079 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:27.962341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 40/87] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:27.963265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:27.989119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:27.991980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.017952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605acfa2-f6cd-4134-a905-3ebd344134b5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.061481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.062526 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.062813 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.063081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.064332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.066370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.073600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 48/88] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:28.073600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.082194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1ab3-15d2-4007-aad6-cab8e6330cfa None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.122299 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.122945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.123222 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.123498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.198282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b8a44-f516-4966-92b2-6a7dff45ef58 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.212803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.214676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.246803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.247456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9904-629c-47e2-a832-21d169345897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.248085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9904-629c-47e2-a832-21d169345897 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.248372 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9904-629c-47e2-a832-21d169345897 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.248651 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9904-629c-47e2-a832-21d169345897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.249388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b9904-629c-47e2-a832-21d169345897 None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:28.249699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b9904-629c-47e2-a832-21d169345897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.251348 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b9904-629c-47e2-a832-21d169345897 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.260822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 49/89] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=a322b06c2e78439baafe5ece304846a2 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:28.261680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9904-629c-47e2-a832-21d169345897 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.279284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.375952 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 41/90] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:28.379508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.424810 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9904-629c-47e2-a832-21d169345897 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.499685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.500243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.500524 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.500799 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.506371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.506371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.506371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 50/91] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:28.506693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.609543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.626366 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973b80-0d34-417b-9c5a-9bd5b7caa909 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.642549 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fdb8b-4017-418d-9cad-13f80a923688 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.679326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:28.689681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.690340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.690720 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.690931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.692623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.694573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.696246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 51/92] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:28.697362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.704507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.705130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.705410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.705688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.706467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=53667c405cc947ceb4171bc3579d9405) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:28.706848 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:28.708312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:28.716775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 42/93] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/role_assignments?user.id=53667c405cc947ceb4171bc3579d9405&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=812192d969e9436d9845f219dd311628 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:28.717574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:28.909779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94385ec-852a-4b4e-acca-07014f28b6cb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.928607 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785401a-f0d0-4fc4-bd4e-5343c5002af6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:28.976033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:28.976673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:28.976958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:28.977235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:28.998231 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:29.019971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:29.020600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:29.020882 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:29.021155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:29.021902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] RBAC: Adding query filter params (role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:29.022213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:29.023794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:29.039340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 43/94] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:29.098267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:29.099776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:29.256452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 52/95] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:29.262824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:29.328307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:29.401256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dca82-49c2-4ece-8850-7aede7fee6af None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:29.450751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:29.451400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:29.454383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:29.454383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] PATH_INFO: `/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:29.458434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] RBAC: Authorizing `identity:get_project(project_id=3c59e22d8b5d47d49f8e3983b817aabf)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:29.459965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46339f3b-fc66-4dad-8132-20790ac38701 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:29.462004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 44/96] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:29 2022] GET /identity/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:29.467718 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:29.560138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:29.630935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a5f0f-5640-480a-8a31-e50545e86105 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:29.677665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:29.678284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:29.678705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:29.678926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:29.679665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=3c59e22d8b5d47d49f8e3983b817aabf, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:29.679977 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:29.681496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf940-b824-4729-a605-309354c31317 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:29.690872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 53/97] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:29 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=3c59e22d8b5d47d49f8e3983b817aabf&role.id=a322b06c2e78439baafe5ece304846a2 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:30.955776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd11f-cc8f-4014-bf0b-518fcf3fc121 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:30.956296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd11f-cc8f-4014-bf0b-518fcf3fc121 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:30.956296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635cd11f-cc8f-4014-bf0b-518fcf3fc121 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:30.957687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 45/98] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:30.967895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29927d7-1ff0-4494-9cda-c01ee6dcb41f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:30.968374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29927d7-1ff0-4494-9cda-c01ee6dcb41f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:30.968444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29927d7-1ff0-4494-9cda-c01ee6dcb41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:30.992415 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c29927d7-1ff0-4494-9cda-c01ee6dcb41f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:30.993602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c29927d7-1ff0-4494-9cda-c01ee6dcb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:31.071642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 54/99] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:31.737629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd11f-cc8f-4014-bf0b-518fcf3fc121 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:31.890096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635cd11f-cc8f-4014-bf0b-518fcf3fc121 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:31.890480 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512c69-6b5a-4feb-b5c7-8b6fcef01963 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:31.890702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512c69-6b5a-4feb-b5c7-8b6fcef01963 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:31.890981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83512c69-6b5a-4feb-b5c7-8b6fcef01963 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:31.892309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 55/100] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:31.907820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eed8-1acd-466b-ae30-4931afff59be None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:31.908117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eed8-1acd-466b-ae30-4931afff59be None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:31.908380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3eed8-1acd-466b-ae30-4931afff59be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:31.921916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:31.943662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7fc3eed8-1acd-466b-ae30-4931afff59be None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:31.945575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7fc3eed8-1acd-466b-ae30-4931afff59be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:31.954516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:31.955166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:31.955450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:31.955730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:31.987321 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:31.992400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:31.993285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:31.994650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 46/101] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:31.999225 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:32.032963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:32.089535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 56/102] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:32.134213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f063-bd12-479a-bc8d-2a0b94d86378 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.134553 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f063-bd12-479a-bc8d-2a0b94d86378 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.134813 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f063-bd12-479a-bc8d-2a0b94d86378 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.136485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 57/103] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:32.142789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c068e-5ad8-4f7b-bb22-3efd7923d256 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.143173 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c068e-5ad8-4f7b-bb22-3efd7923d256 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.143460 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c068e-5ad8-4f7b-bb22-3efd7923d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.174316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2b6c068e-5ad8-4f7b-bb22-3efd7923d256 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:32.175541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2b6c068e-5ad8-4f7b-bb22-3efd7923d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:32.230374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fada60-8b4c-40c2-8d2a-cf20974e5e9b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:32.280822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 58/104] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:32.282555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9ef1-efe5-4b33-8ca1-417869e0c894 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.283204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9ef1-efe5-4b33-8ca1-417869e0c894 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.283672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9ef1-efe5-4b33-8ca1-417869e0c894 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.290329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 59/105] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:32.292702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.293209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.293675 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.314008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:32.315615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.316126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.316619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.317724 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:32.318929 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:32.319937 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:32.320890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:32.324301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:32.344705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 47/106] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:32.350537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:32.419953 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:32.481054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fec69-2974-45f2-a8d4-2d19dfd7ca32 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:32.503804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 60/107] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:32.526282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:32.527268 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.527800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.528271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] PATH_INFO: `/v3/users/af14916fb80c4bab9d987dd699c37a04` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.551148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] RBAC: Authorizing `identity:get_user(user_id=af14916fb80c4bab9d987dd699c37a04)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:32.552924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:32.555064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 48/108] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:32 2022] GET /identity/v3/users/af14916fb80c4bab9d987dd699c37a04 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:32.563500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:32.610541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:32.629712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:32.702136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1d76c-58d5-40bf-a83d-4cd458526ded None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:32.752259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499232-cb16-4676-a511-cd276ede5f0d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:32.763516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:32.779684 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:32.780320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.780603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.780880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.797750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:32.798806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:32.799291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:32.799791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:32.801101 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:32.802874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:32.807779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 49/109] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:32.811909 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:32.902679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:32.904670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:32.950900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:32.956573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d3f9e-7ae2-4650-a3e2-96a4ba3e34f2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.002921 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.003805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.004089 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.004359 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.005171 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.007480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832caa3f-59dc-437c-9db6-e1cd055d3e02 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.038937 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 50/110] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:07:32 2022] POST /identity/v3/projects => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:07:33.040046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 61/111] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:33.040496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7179-ebc7-494f-8154-0391dae3b680 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.040568 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7179-ebc7-494f-8154-0391dae3b680 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.040809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7179-ebc7-494f-8154-0391dae3b680 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.042296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 51/112] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:33.043046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7179-ebc7-494f-8154-0391dae3b680 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.045336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.065662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.171316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7179-ebc7-494f-8154-0391dae3b680 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.211365 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.212009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.212279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.212623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.217517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fe7f3-c7ce-4041-8d9a-9c28012432ee None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.224565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:33.229561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:33.230713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:33.231523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 52/113] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:33.232168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.268503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.280508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.281371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.281816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.282238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.300530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1c31338a-3952-4ed2-a419-c6a148e76b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:33.306440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:33.307424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:33.308164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 62/114] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:33.308787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.309130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.309998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.329869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:33.334448 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:33.344746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.374822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5493ef-1e78-4dcb-9994-61100e93417d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.415265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 63/115] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:33.416647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.423161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.423802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.424085 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.424360 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.425494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.426991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.429269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 53/116] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:33.430624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.554024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0ae1d-47e7-4970-a87d-135f0e032814 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.562920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771318-4b23-4cff-9617-893bd9d2096b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.579849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.594920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.595523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.595975 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.596139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.596779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:33.597102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.598599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8fb6b-3d1d-4bf2-a25c-86cfdb91d924 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.601549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.602453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.602925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.603397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.604260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:33.604748 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.606292 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.607975 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 64/117] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:33.613885 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29e-f4f0-438a-9e31-d3dc77b8bdc3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.614318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29e-f4f0-438a-9e31-d3dc77b8bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.614623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facc29e-f4f0-438a-9e31-d3dc77b8bdc3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.616721 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 65/118] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:33.617302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc29e-f4f0-438a-9e31-d3dc77b8bdc3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.618133 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 54/119] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:33.619253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.631286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.728774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f6afe-0f20-42b9-9f47-b519bc64a6b2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.749711 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facc29e-f4f0-438a-9e31-d3dc77b8bdc3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:33.763647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.764274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.764763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.764870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.765938 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.767394 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63a414-752e-4b61-a603-e1aa8bf162a2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.773907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 55/120] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:33.773907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.773907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.773907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.790012 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:33.791032 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:33.791255 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:33.792065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:33.792545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:33.793006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:33.793920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=af14916fb80c4bab9d987dd699c37a04) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:33.794388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:33.796001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:33.802435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 66/121] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/role_assignments?user.id=af14916fb80c4bab9d987dd699c37a04&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:33.803510 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.880250 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.892973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 56/122] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:33.893761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:33.905734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:33.986910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052c9b3-9be1-4519-853a-deb49076eea2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.045410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.046916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.047399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.047881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.049245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.050918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.053129 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 67/123] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:34.054742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.077884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5bb5f-a16c-447c-b3d9-6d761937a0ff None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.113279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.113914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.114194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.114520 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.124999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:34.129808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:34.130755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:34.132066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 57/124] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:34.132707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.199266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd4e5-7245-44c3-9388-a0f8cde576d1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.223696 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:34.233741 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:34.269704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.270356 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.270641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.270914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.273631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.275109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.277365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 68/125] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:34.278148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.291667 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66216d-478a-405d-8fd4-efd977f8a7d4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.353879 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.354548 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.354831 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.355104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.356387 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.357893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.359553 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 58/126] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:34.360533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.404517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfee09-df40-4919-a2b7-e30e9c2ba000 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.445163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.446167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.446686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.447162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.448048 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:34.448563 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.450145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.460170 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 69/127] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:34.465183 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.477499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab577e-60c9-4f6a-a647-2fb178926edf None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.514680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:34.516008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.516891 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.517342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.517776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/45c7d26095714830a97140f749aab33f/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.520115 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, user_id=45c7d26095714830a97140f749aab33f, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.522301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.525927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:34.544125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 59/128] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:34 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/45c7d26095714830a97140f749aab33f/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:34.545292 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.611504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f467a0a-1c29-4e23-89d9-49ec25ebf02d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.682726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.683990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.684465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.684926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.698957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:34.705439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:34.706474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:34.707393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:34.710027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 70/129] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:34.715650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.800445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238970fe-f610-49f2-88eb-9608794c0f6a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.839263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec0f88-361d-4ce9-b107-b6f7820cc587 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:34.847879 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:34.867790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.869058 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.869443 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.869824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/53667c405cc947ceb4171bc3579d9405/roles/812192d969e9436d9845f219dd311628` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.872309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, user_id=53667c405cc947ceb4171bc3579d9405, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.874533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.888770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:34.889680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:34.890088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:34.890528 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:34.891800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:34.893391 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:34.895137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 71/130] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:34.895802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 60/131] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:34 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/53667c405cc947ceb4171bc3579d9405/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:34.896340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:34.901805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:35.017888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:35.035159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bb935-14de-42c8-9ff4-0e8464b54bef None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.077165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.077808 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.078159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.078533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.079282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:35.079672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.081205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.091824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 72/132] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:35.097815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:35.163404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd93b0f-4b6b-4ee2-bff7-5d917eef8986 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.186730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:35.256115 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.256779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.257062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.257337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.261684 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.263317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.265091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 61/133] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:34 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:35.275532 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:35.360784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc8b3-3c5d-41ec-a7a6-6833b3200385 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.436061 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.438095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.438095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.438095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.439987 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.441456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.445391 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 73/134] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:35 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:35.461501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:35.505818 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b47d31-ddaf-4039-ae68-25cf5c3701b3 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.553510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:35.575325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.576251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.576530 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.576806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/45c7d26095714830a97140f749aab33f/roles/6c1bfab1b76347f9a793a9ae11e773e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.582227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, user_id=45c7d26095714830a97140f749aab33f, role_id=6c1bfab1b76347f9a793a9ae11e773e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.583725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.608720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 62/135] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:35 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/45c7d26095714830a97140f749aab33f/roles/6c1bfab1b76347f9a793a9ae11e773e1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:35.629942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa29ea-904b-4567-ac5d-c8940d8e9126 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.632992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:35.668365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.669011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.669286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.669572 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] PATH_INFO: `/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.670777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] RBAC: Authorizing `identity:get_project(project_id=3c59e22d8b5d47d49f8e3983b817aabf)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.672234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae5e99-0cb2-4675-a29c-4cbb59ffd0ec None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.674487 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 74/136] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:35 2022] GET /identity/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:35.680689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:35.812195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528b54-38ed-4a7d-8808-4f8bd72893a1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:35.860276 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:35.860964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:35.861243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:35.861516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] PATH_INFO: `/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf/users/45c7d26095714830a97140f749aab33f/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:35.863479 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c59e22d8b5d47d49f8e3983b817aabf, user_id=45c7d26095714830a97140f749aab33f, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:35.864949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2506d13-7886-43ce-827c-92b29505fb76 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:35.885421 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 63/137] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:35 2022] PUT /identity/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf/users/45c7d26095714830a97140f749aab33f/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:36.067713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f7bf-6ded-4e5c-b9c1-e7a27647a8d7 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:36.068316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f7bf-6ded-4e5c-b9c1-e7a27647a8d7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:36.068438 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037f7bf-6ded-4e5c-b9c1-e7a27647a8d7 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:36.069868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 75/138] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:36.076127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:36.076424 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:36.076687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:36.100743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:36.101991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:36.146478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:36.187686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 64/139] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:36.798871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f7bf-6ded-4e5c-b9c1-e7a27647a8d7 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:36.920676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037f7bf-6ded-4e5c-b9c1-e7a27647a8d7 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:36.963755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:36.964388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:36.964664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:36.964931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:36.966709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:36.968265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522f52d-af02-4529-a2c9-b434f8cef298 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:36.970840 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 76/140] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:36.975598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:37.102393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c0e0d-7a5b-4d1a-bdfa-d51ce29c53c3 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:37.142316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:37.143027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:37.143311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:37.143734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:37.144433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:37.145874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241abd9-2445-494c-9528-70bd4a87eb39 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:37.185582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 65/141] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:36 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:37.400200 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5edb2-6381-4cab-a8ba-cd0dfba5e265 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:37.400558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5edb2-6381-4cab-a8ba-cd0dfba5e265 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:37.400740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5edb2-6381-4cab-a8ba-cd0dfba5e265 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:37.402368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 77/142] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:37.408110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9df3-744d-4f66-ac6c-d2a0192473b3 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:37.408579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9df3-744d-4f66-ac6c-d2a0192473b3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:37.408670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9df3-744d-4f66-ac6c-d2a0192473b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:37.433214 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-289b9df3-744d-4f66-ac6c-d2a0192473b3 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:37.434446 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-289b9df3-744d-4f66-ac6c-d2a0192473b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:37.469506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:37.531080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 66/143] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:37.637811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae851ae-a5f9-4df5-b44b-7fa429ae068c None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:37.638457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae851ae-a5f9-4df5-b44b-7fa429ae068c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:37.638964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae851ae-a5f9-4df5-b44b-7fa429ae068c None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:37.640499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 78/144] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:37.645868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253f7d-47e7-4d22-91f3-70edac5c9b79 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:37.646429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253f7d-47e7-4d22-91f3-70edac5c9b79 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:37.647528 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33253f7d-47e7-4d22-91f3-70edac5c9b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:37.678835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-33253f7d-47e7-4d22-91f3-70edac5c9b79 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:37.680592 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-33253f7d-47e7-4d22-91f3-70edac5c9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:37.784810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 67/145] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:38.288103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae851ae-a5f9-4df5-b44b-7fa429ae068c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.343257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:38.358560 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cea-4dd3-47fc-bc15-f30de6caefd1 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.359216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cea-4dd3-47fc-bc15-f30de6caefd1 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.359716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cea-4dd3-47fc-bc15-f30de6caefd1 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.361609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 68/146] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:38.368391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.369005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.369496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.402392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:38.404049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:38.416325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae851ae-a5f9-4df5-b44b-7fa429ae068c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:38.456659 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:38.457559 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.457978 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.458416 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.470927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:38.477131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:38.478240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:38.479145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:38.481589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 79/147] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:38.482656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.517805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 69/148] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:38.519569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.540325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:38.593840 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810698-b68a-4b4d-b71d-aa0436effbfe None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:38.596533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:38.634723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:38.635305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.635562 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.635829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.637930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa8a4-3988-4070-a786-852d11e9505d None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:38.647056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:38.652543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:38.653451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:38.654234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 80/149] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:38.662669 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.690247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:38.691508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.692019 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.692530 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.694250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:38.694895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:38.696642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:38.711233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 70/150] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:38.717251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.778749 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e94bd-8d61-4868-afdb-dbc68e98247f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:38.820404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:38.821029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.821300 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.821570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.822305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:38.822660 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:38.824116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:38.826466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:38.833659 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 81/151] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:38.851481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:38.861582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2a49b-4d17-453b-b97e-b5785e450b1f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:38.887947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:38.911117 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:38.912169 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:38.913352 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:38.914642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] PATH_INFO: `/v3/users/af14916fb80c4bab9d987dd699c37a04` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:38.920123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] RBAC: Authorizing `identity:get_user(user_id=af14916fb80c4bab9d987dd699c37a04)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:38.921955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:38.923816 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 71/152] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/users/af14916fb80c4bab9d987dd699c37a04 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:38.931458 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.031551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b4192-8f37-4f8a-a4fa-a9bf5d154ae2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.081761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.084546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.084546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.084546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.085441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:39.087081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:39.089130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 82/153] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:39.094925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e53d6b-2bda-4b49-8682-b543f82df94e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.120035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.145424 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.148033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.148812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.149258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.151878 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:39.156995 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:39.161757 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 72/154] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:38 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:39.180179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.218741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:39.296079 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:39.308841 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac520e-09b5-4087-a34d-10543e104e8d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.335679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee5d58-1183-40b8-82b7-8554afa989fb None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.353389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.354514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.355431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.355874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.381945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.383487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.383916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.384288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/af14916fb80c4bab9d987dd699c37a04/roles/6dffaef4aeea4b8abb78f313f36a0b91` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.386983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, user_id=af14916fb80c4bab9d987dd699c37a04, role_id=6dffaef4aeea4b8abb78f313f36a0b91)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:39.390850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:39.410654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 73/155] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:39 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/users/af14916fb80c4bab9d987dd699c37a04/roles/6dffaef4aeea4b8abb78f313f36a0b91 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:07:39.411512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.509148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:39.510678 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:39.588516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:39.625718 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56588c49-d943-4725-b76a-d3dd1f3e07fc None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.702377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:39.707254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.708192 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.708192 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.708460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.716150 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 83/156] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:39.726924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.737833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:39.746541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:39.747554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:39.748318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 74/157] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:39.761535 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.856060 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544db4-5ee5-4337-883e-9ea76c437d62 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:39.898561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:39.899662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:39.900137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:39.900740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:39.902109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:39.904127 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:39.906163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 84/158] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:39 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:39.913677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:39.973985 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19913d-3a27-4183-b5c7-8a8d35af4a34 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:40.005644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:40.061436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:40.062077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.062371 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.062663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.063347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:40.063647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:40.065054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e1c49-d630-4e85-aba5-4a65cb14ed66 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:40.070381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:40.083558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 75/159] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:40.084950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eee627-5774-49b5-b16f-9dcf5f65494f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.085234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eee627-5774-49b5-b16f-9dcf5f65494f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.085509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eee627-5774-49b5-b16f-9dcf5f65494f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.089137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35818f-45c1-48fb-b8ea-3a3bd3943c93 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:40.090833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 76/160] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:40.091679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eee627-5774-49b5-b16f-9dcf5f65494f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:40.175801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:40.176329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.176603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.176869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.177665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:40.177973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:40.179456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858e63-d616-4ef3-abfe-55c84a00f3b0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:40.204313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 85/161] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:39 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=a322b06c2e78439baafe5ece304846a2 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:40.205581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97808d7-3bfb-41e4-ab61-f8b26d820e4a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.205863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97808d7-3bfb-41e4-ab61-f8b26d820e4a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.206134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97808d7-3bfb-41e4-ab61-f8b26d820e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.242428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f97808d7-3bfb-41e4-ab61-f8b26d820e4a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:40.243647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f97808d7-3bfb-41e4-ab61-f8b26d820e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:40.330534 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eee627-5774-49b5-b16f-9dcf5f65494f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:40.368373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 86/162] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:40.369824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b74a3-2d6d-450d-83d5-140bc9ba6269 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.370112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b74a3-2d6d-450d-83d5-140bc9ba6269 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.370492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b74a3-2d6d-450d-83d5-140bc9ba6269 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.372015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 87/163] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:40.378777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.379083 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.379318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.411406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:40.412774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:40.417211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:40.417868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.418144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.418437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] PATH_INFO: `/v3/users/53667c405cc947ceb4171bc3579d9405` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.423120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] RBAC: Authorizing `identity:get_user(user_id=53667c405cc947ceb4171bc3579d9405)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:40.424585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:40.426460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 77/164] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:40 2022] GET /identity/v3/users/53667c405cc947ceb4171bc3579d9405 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:40.435963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:40.502600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:40.534501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 88/165] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:40.577868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:40.623021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f7a13-c64f-4952-908a-bd3f52b82059 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:40.671834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:40.672457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:40.672733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:40.673000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:40.760374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:40.768205 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:40.846120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:40.889944 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 78/166] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:40.895535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.029124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7167b-017b-4c8d-96ce-372591ef8635 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.076264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.077035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.077322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.077593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.078781 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:41.080258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:41.082136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 89/167] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:40 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:41.088509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.122392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.206752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:41.219246 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac960e-a2f2-4b0a-b672-c17c9870c2ea None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.261517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.262135 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.262434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.262712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.263447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=53667c405cc947ceb4171bc3579d9405) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:41.263747 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:41.265196 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:41.271853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 79/168] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/role_assignments?user.id=53667c405cc947ceb4171bc3579d9405&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=812192d969e9436d9845f219dd311628 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:41.273046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5150d-d7ef-4089-bbcd-002018ebf2a5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.342152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.342847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.343126 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.343398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.358625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:41.363742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:41.364693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:41.366013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 90/169] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:41.376016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.427235 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:41.441462 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.524797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26558b-ed29-427f-9362-da3355d61ab6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.561922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.562565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.562846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.563119 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.564166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:41.564472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:41.565863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:41.576645 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 80/170] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:41.582586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.688817 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:41.695254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41adcde-8884-4e8f-aca5-49c590b6e756 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.735735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.736385 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.736665 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.736937 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.738095 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:41.739785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:41.741619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 81/171] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:41.747362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.757774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52afba-5cb6-49f7-b881-063fb54de7e4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.779793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:41.851122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.852146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.852632 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.853086 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.869180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3910b6-ccec-4f11-abd0-6f6e184fb5e2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:41.891958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:41.903857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:41.904856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:41.905645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:41.908491 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 91/172] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:41.908667 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:41.914072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:41.914072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:41.914072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:41.915582 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:41.954457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:42.010598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:42.012088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:42.125567 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94fdae-535d-47d7-b83a-0977e7948922 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:42.143142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 82/173] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:42.149194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:42.185020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:42.185631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.185899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.186164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.186866 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:42.187166 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:42.188541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:42.206190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 92/174] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:42.214959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:42.215982 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:42.255209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b92cc5-4fee-4bc3-9a35-deef13d1fc67 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:42.287432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:42.290177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:42.290874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.291262 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.291648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] PATH_INFO: `/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.292846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] RBAC: Authorizing `identity:get_project(project_id=3c59e22d8b5d47d49f8e3983b817aabf)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:42.294368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:42.296340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 83/175] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:42 2022] GET /identity/v3/projects/3c59e22d8b5d47d49f8e3983b817aabf => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:42.302104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:42.458533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5289a1-a055-4868-876a-24fec2f44e9c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:42.506167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf46a0-2ce9-463a-b335-8f3a921bb8c5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:42.527087 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:42.534035 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:42.534991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.535490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.535951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.537415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=3c59e22d8b5d47d49f8e3983b817aabf, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:42.537930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:42.539676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:42.554548 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 84/176] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:42 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=3c59e22d8b5d47d49f8e3983b817aabf&role.id=a322b06c2e78439baafe5ece304846a2 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:42.641237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:42.641937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.642213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.642505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] PATH_INFO: `/v3/users/45c7d26095714830a97140f749aab33f` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.643877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] RBAC: Authorizing `identity:get_user(user_id=45c7d26095714830a97140f749aab33f)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:42.645324 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9eef0-3b12-41f0-81e7-8e47a802ad68 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:42.647691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 93/177] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:42 2022] GET /identity/v3/users/45c7d26095714830a97140f749aab33f => generated 275 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:42.655509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:42.843940 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1148f1-7d5a-418a-b634-2f5b7943ed38 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.844377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1148f1-7d5a-418a-b634-2f5b7943ed38 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.844475 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1148f1-7d5a-418a-b634-2f5b7943ed38 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.845958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 94/178] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:42.856023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.856215 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.856484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:42.859392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d253e-7d2a-42e9-b6c9-37b114d64422 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:42.913933 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:42.915160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:42.953295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:42.954417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:42.954900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:42.955386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.108728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:43.144044 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 95/179] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:43.157429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:43.159256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ee77-b804-47b5-85bc-15f01665758d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:43.342697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 85/180] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:43.348158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:43.394971 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:43.507878 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772fe5-1ee5-4661-9781-9c1444d18e71 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:43.536662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b694-bf69-484f-a021-1a0ab3718c68 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.537013 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b694-bf69-484f-a021-1a0ab3718c68 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.537204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541b694-bf69-484f-a021-1a0ab3718c68 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.538672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 86/181] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:43.544709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.545354 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.545847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.571134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:43.571341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:43.572262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.572567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:43.572960 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.573423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.575047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:43.576860 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:43.578756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 96/182] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:43 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:43.579737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:43.648963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 87/183] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:43.654016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:43.691237 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:43.706085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:43.711350 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d2f-7c52-4853-8786-4e07d3ad5048 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:43.756454 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34952673-2290-470b-b307-37fcd617f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:43.757015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34952673-2290-470b-b307-37fcd617f327 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.757293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34952673-2290-470b-b307-37fcd617f327 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.757565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34952673-2290-470b-b307-37fcd617f327 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.769072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34952673-2290-470b-b307-37fcd617f327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-34952673-2290-470b-b307-37fcd617f327 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:43.774020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:43.774959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:43.775750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 97/184] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:43.776419 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12c77-9730-46ed-97fe-05d7bb4668b5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.777241 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12c77-9730-46ed-97fe-05d7bb4668b5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.777241 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff12c77-9730-46ed-97fe-05d7bb4668b5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.783742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 98/185] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:43.785409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff12c77-9730-46ed-97fe-05d7bb4668b5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:43.796581 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37305f6b-862f-43f4-acd5-1bbf3e34eacd None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:43.837652 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:43.838806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.839307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.839773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.840700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] RBAC: Adding query filter params (role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=45c7d26095714830a97140f749aab33f) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:43.841207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:43.842930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68645ea-1da8-4790-97f0-981756d5351d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:43.850209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 88/186] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:43 2022] GET /identity/v3/role_assignments?user.id=45c7d26095714830a97140f749aab33f&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:43.851805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.852287 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.852754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.872526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:43.876744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:43.917338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff12c77-9730-46ed-97fe-05d7bb4668b5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:43.956380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 89/187] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:43.966203 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:43.966863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:43.967198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:43.967472 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:43.968154 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:43.968513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:43.970108 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:43.980892 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 99/188] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:43.987104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.012454 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.018243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.063883 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.139306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044304c-10e5-49b9-8637-c07ffc276d3a None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.185339 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a8b26-3c49-4e01-9502-a986b07c9393 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.187244 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.188136 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.188414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.188799 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.204690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.206316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5339f8b-ea43-4ed3-9b5a-a9c8ee3a655b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.208978 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 90/189] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:43 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:44.210254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d790-8590-4c45-9aee-e400cb5f9f37 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.215087 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d790-8590-4c45-9aee-e400cb5f9f37 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.215481 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7d790-8590-4c45-9aee-e400cb5f9f37 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.218145 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 91/190] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:44.218145 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d790-8590-4c45-9aee-e400cb5f9f37 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.225968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.226660 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.226935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.227787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.239066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4980593a-d18c-48fd-bd5e-3a14360ae998 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:44.245648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:44.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:44.247820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 100/191] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:44.248689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.248689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.248689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.266604 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:44.267811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:44.313396 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.340527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7d790-8590-4c45-9aee-e400cb5f9f37 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.342501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 101/192] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:44.343357 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.354490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.384347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.384955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.385232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.385502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.459352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f5dd8-d5dd-4bdd-8ca3-4dea03cec4c1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.462802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.464282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.501123 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.502011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.502465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.502882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.503554 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:44.503857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.505256 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.518667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 102/193] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:44.518667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.549239 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.577094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 92/194] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:44.581940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.627566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.659173 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0477cc9-ef6d-48c1-82ca-4ac9cafd6a50 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.694299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.694953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.695226 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.695492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.696581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.698027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.699597 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 103/195] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:44.700346 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.723629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95c706-51c3-4d23-8060-a5d3db133233 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.757949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.758618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.758894 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.759162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.760334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.761781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.763382 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 93/196] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:44.767232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.800285 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12924cf-5082-4e70-99b4-b0c59436bb78 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.809822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.834690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.835320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.835590 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.835858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.836958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.838413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:44.840003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 104/197] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:44.844984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.855694 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:44.869016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f69dbe-0cf3-4cec-aa66-a52cb61ef380 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.901915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.902578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.902837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.903116 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.913438 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:44.918699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:44.919587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:44.920374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 94/198] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:44.921598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:44.945259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0d5de-454a-4a5f-8cbb-9cb361ae311a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:44.979572 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:44.980099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:44.980376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:44.980638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:44.981273 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:44.982742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.001864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 105/199] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:44 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:45.001864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.044194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27794d-6d5c-40a7-a134-e9b3cd4d519b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.045917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.078194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.087428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.088050 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.088327 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.088650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.125646 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfd9e0-7654-498b-99c9-05109d1f6381 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.165324 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.165947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.166392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.166500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.167253 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=ac5edf3b8354465897c6f93b6683cae6) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:45.167560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.169038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.169459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.171045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.175686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 106/200] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/role_assignments?user.id=ac5edf3b8354465897c6f93b6683cae6&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=812192d969e9436d9845f219dd311628 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:45.175686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.311950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 95/201] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:45.323509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.325887 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.331286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c083cd-0529-45e7-9321-45c5b2b4af37 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.370686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.381835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.382932 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.383414 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.383946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.385239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:45.385824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.387573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.398657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 107/202] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:45.405032 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.455370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217a010-2d16-4e40-8bc1-1a8ffda9ca33 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.499171 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.499874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.500178 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.500453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.502274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.503787 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.506436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 96/203] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:45.512898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.552252 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796d288-a1c1-4425-ae55-b83c4be1130f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.595874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.597204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.597808 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.598238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] PATH_INFO: `/v3/users/af14916fb80c4bab9d987dd699c37a04` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.600398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] RBAC: Authorizing `identity:get_user(user_id=af14916fb80c4bab9d987dd699c37a04)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.601922 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.604611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 108/204] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/users/af14916fb80c4bab9d987dd699c37a04 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:45.609825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:45.622740 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.658670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486dd15-6ccf-406a-99fb-aaaa71e38d47 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.680317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:45.728806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ca8-73fc-4d44-94b0-e7ff100074fa None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:45.734556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.735227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.735508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.735909 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.736643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] RBAC: Adding query filter params (role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=ac5edf3b8354465897c6f93b6683cae6) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:45.737057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.746793 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.753883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 97/205] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/role_assignments?user.id=ac5edf3b8354465897c6f93b6683cae6&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:45.767400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:45.768043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:45.768388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:45.768669 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:45.848444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:45.849909 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:45.939425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:46.004318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 109/206] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:46.010512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:46.159435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4269e-4464-4721-9332-8d7f2792deb6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:46.209090 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:46.209811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:46.210088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:46.210375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:46.215800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:46.217259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966782ee-c31d-4613-a1f1-e3dae163f9ea None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:46.219280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 98/207] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:46 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:46.225390 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:46.373145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a97888-a6ec-40de-86ee-d5e6b2606bf3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:46.414025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:46.415041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:46.415525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:46.416011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:46.416935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1, user.id=af14916fb80c4bab9d987dd699c37a04) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:46.417453 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:46.419125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4440-e171-4148-95d8-8d2a16aee44f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:46.425823 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 110/208] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:46 2022] GET /identity/v3/role_assignments?user.id=af14916fb80c4bab9d987dd699c37a04&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:48.023583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec393a4-a507-4ffe-aef1-a4f52da1480a None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.024140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec393a4-a507-4ffe-aef1-a4f52da1480a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.024140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec393a4-a507-4ffe-aef1-a4f52da1480a None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.025716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 99/209] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:48.031301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52eed6-91d2-45b2-ba90-2d8edc2ac408 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.031762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52eed6-91d2-45b2-ba90-2d8edc2ac408 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.031864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52eed6-91d2-45b2-ba90-2d8edc2ac408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.051353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4e52eed6-91d2-45b2-ba90-2d8edc2ac408 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:48.053107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4e52eed6-91d2-45b2-ba90-2d8edc2ac408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:48.072969 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:48.134629 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 111/210] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:48.165854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82517783-2177-488c-b6b6-80ffdb11e71b None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.166425 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82517783-2177-488c-b6b6-80ffdb11e71b None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.166842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82517783-2177-488c-b6b6-80ffdb11e71b None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.168358 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 100/211] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:48.174001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04522c7-4f42-4c22-b779-3140a0fdd70c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.174554 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04522c7-4f42-4c22-b779-3140a0fdd70c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.174998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04522c7-4f42-4c22-b779-3140a0fdd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.196332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d04522c7-4f42-4c22-b779-3140a0fdd70c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:48.197756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d04522c7-4f42-4c22-b779-3140a0fdd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:48.234575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeef1b-36f0-4b85-a521-a8d4f63d0414 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.235342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeef1b-36f0-4b85-a521-a8d4f63d0414 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.235838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eeef1b-36f0-4b85-a521-a8d4f63d0414 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.238547 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 101/212] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:48.248577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519d43-9e17-4595-a45c-7eaaee53f5c4 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.249253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519d43-9e17-4595-a45c-7eaaee53f5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.249725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1519d43-9e17-4595-a45c-7eaaee53f5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.257090 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:48.272047 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f1519d43-9e17-4595-a45c-7eaaee53f5c4 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:48.273577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f1519d43-9e17-4595-a45c-7eaaee53f5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:48.276091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 112/213] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:48.362461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 102/214] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:48.430956 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe4c-5c3f-46b7-b408-04da00b66eb1 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.431296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe4c-5c3f-46b7-b408-04da00b66eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.431505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dffe4c-5c3f-46b7-b408-04da00b66eb1 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.433268 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 113/215] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:48.438653 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.438940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.439214 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.459461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:48.460643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:48.475274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffe4c-5c3f-46b7-b408-04da00b66eb1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:48.548961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 103/216] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:48.584602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:48.605668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dffe4c-5c3f-46b7-b408-04da00b66eb1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:48.641352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:48.642228 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.642698 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.643109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.654753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:48.660259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:48.661437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:48.662402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:48.664519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 114/217] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:48.670581 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:48.686337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:48.742109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:48.791824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941625a-7300-4097-a0b1-9c639d9dcd97 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:48.832148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:48.833357 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.833795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.834254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.835427 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:48.835915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:48.837395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117133a-afad-4621-8e8b-a56f59ebe343 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:48.838303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:48.851024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 104/218] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:48.852093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:48.884058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:48.884696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:48.884974 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:48.885250 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:48.901588 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:48.906473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:48.907500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:48.908308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 115/219] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:48.908986 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:48.914851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:48.971158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff1ceb-5b5e-4e1d-a6ae-c62c7b598f1f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:48.998601 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.010641 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.011280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.011556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.011828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.012972 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.014447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.016014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 105/220] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.016196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e562704-b079-4aac-a2ed-a95f9b19dc76 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.016783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.060486 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.061984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.061984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.061984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] PATH_INFO: `/v3/users/b202bc5f52294963888a0a41c0af77ea` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.076403 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] RBAC: Authorizing `identity:get_user(user_id=b202bc5f52294963888a0a41c0af77ea)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.077861 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.079682 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 116/221] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:48 2022] GET /identity/v3/users/b202bc5f52294963888a0a41c0af77ea => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.080395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.132698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c022f-3ad1-4476-9923-cc47e705c0b0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.147152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.171475 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.172108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.172420 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.172687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.183381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:49.188278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:49.189491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 106/222] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:49.190290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.194884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a070-1f7a-461e-ba39-f796241ac955 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.232956 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.233919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.233919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.234107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.234793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:49.235096 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.236474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.246473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 117/223] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.248179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.251950 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.300562 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046376b5-1d11-44d5-a7ac-65af7199a0e2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.336202 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.336805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.337077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.337345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.337986 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.339470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.360287 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef9a4-174a-44cb-b310-130ae567879d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.369063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 107/224] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:49 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:49.370279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.399304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.420609 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.421387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.421733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.422113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.512760 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688b17-f0b4-44b2-97ae-7eab22cdf35b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.524338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.526155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.527457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.562358 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.563429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.564005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.564283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.564971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:49.565272 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.568614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.578404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 108/225] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.579160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.663340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 118/226] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:49.664601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.694920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.725247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d418c-a6b1-4548-bc35-4530b88602fc None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.769391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.770037 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.770434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.770702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.772046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.774110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.776403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 109/227] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.777456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.799739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3acaf-aea1-4c64-a073-9450ea585281 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.838381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.851589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.852155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.852598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.852853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.854065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.855740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.857400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 119/228] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.858184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:49.922033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cb267-ce1c-4ed3-8f3f-1290ddd2538b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:49.977804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:49.978512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:49.978788 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:49.979055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:49.980820 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:49.982617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:49.983446 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:49.985682 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 110/229] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:49.991154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:50.001849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25964a4d-446c-4597-93c5-330eaf68d0c1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:50.050971 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:50.051812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:50.052157 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:50.052496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:50.054197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:50.056321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:50.062385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 120/230] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:50.062385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:50.129638 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbba6-80d5-4b94-a93a-bacc966ee58d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:50.138760 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:50.178607 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:50.179258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:50.179607 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:50.179951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:50.181467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:50.183123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:50.184857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 111/231] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:49 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:50.190579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:50.202452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab9d0-3519-4a8e-901f-daac842b8530 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:50.242683 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:50.243647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:50.244257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:50.244708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:50.245668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=b202bc5f52294963888a0a41c0af77ea) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:50.246155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:50.247927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:50.255397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 121/232] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:50 2022] GET /identity/v3/role_assignments?user.id=b202bc5f52294963888a0a41c0af77ea&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=a322b06c2e78439baafe5ece304846a2 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:50.266015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:50.296643 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:50.341768 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473bcf8-b49a-415b-baa9-eca85dde6cae None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:50.389117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699ab43-6cb6-4511-839f-10ba45efc10e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:50.408579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:50.409341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:50.409895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:50.410002 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/ac5edf3b8354465897c6f93b6683cae6/roles/812192d969e9436d9845f219dd311628` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:50.412285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, user_id=ac5edf3b8354465897c6f93b6683cae6, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:50.413862 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d15a9-0212-4975-908f-51e1bf17d447 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:50.430295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:50.431358 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:50.432054 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:50.432507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/ac5edf3b8354465897c6f93b6683cae6/roles/6c1bfab1b76347f9a793a9ae11e773e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:50.436059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, user_id=ac5edf3b8354465897c6f93b6683cae6, role_id=6c1bfab1b76347f9a793a9ae11e773e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:50.438056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed603285-a7b4-4846-a43d-24a5f21bf929 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:50.446466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 112/233] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:50 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/ac5edf3b8354465897c6f93b6683cae6/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:50.468351 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 122/234] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:50 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/ac5edf3b8354465897c6f93b6683cae6/roles/6c1bfab1b76347f9a793a9ae11e773e1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:52.360547 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277572-67af-40b1-bfd4-ca0183e65c76 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:52.361515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277572-67af-40b1-bfd4-ca0183e65c76 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:52.361984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f277572-67af-40b1-bfd4-ca0183e65c76 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:52.364061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 113/235] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:52.369838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0a6e-5ce2-4e50-bf0a-5223801950cf None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:52.370745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0a6e-5ce2-4e50-bf0a-5223801950cf None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:52.371248 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0a6e-5ce2-4e50-bf0a-5223801950cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:52.390612 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d16e0a6e-5ce2-4e50-bf0a-5223801950cf None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:52.392139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d16e0a6e-5ce2-4e50-bf0a-5223801950cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:52.496954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 123/236] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:52.515854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f720d3-6d01-4d91-b05a-2a31fee1327f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:52.516475 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f720d3-6d01-4d91-b05a-2a31fee1327f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:52.516950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f720d3-6d01-4d91-b05a-2a31fee1327f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:52.518582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 114/237] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:52.525028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:52.525307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:52.525577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:52.551386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:52.553043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:52.561442 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:52.666094 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 124/238] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:53.099985 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f720d3-6d01-4d91-b05a-2a31fee1327f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.120284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.149477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:53.275235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eab630-dcbc-4852-8f0c-904fb33c471d None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.293130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f720d3-6d01-4d91-b05a-2a31fee1327f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.341281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:53.341929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.342205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.342504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.344908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:53.346397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:53.348407 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 125/239] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:53.352830 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:53.353471 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.353749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.354048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.355410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.374558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:53.381455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:53.389851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:53.390791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:53.391572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:53.395722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 115/240] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:53.400325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.521027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac9da6-214e-41d8-9e30-9679be703049 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.536668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:53.543477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512776-4aef-442a-ab6a-3bc70ffbf025 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.565837 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:53.567103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.567386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.567653 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.568547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:53.570869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f31e89-1b71-47cb-85cf-2495fc8c8621 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:53.580869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:53.581487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.581769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.582038 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.582792 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:53.583097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:53.584500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605d39-5284-4257-8dda-7abf789e3efa None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:53.593303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 126/241] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:53 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:07:53.594594 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3fc84-4dff-496a-bb88-ee337db2794d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.594857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 116/242] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:53.594978 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3fc84-4dff-496a-bb88-ee337db2794d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.595149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3fc84-4dff-496a-bb88-ee337db2794d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.596162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fe7a-6c02-463a-9122-5cb33f14e1ca None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.596370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 127/243] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:53.596935 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fe7a-6c02-463a-9122-5cb33f14e1ca None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.597204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16fe7a-6c02-463a-9122-5cb33f14e1ca None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.597444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f729d-f4f9-4a9d-97e2-460da7f797f8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.597727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f729d-f4f9-4a9d-97e2-460da7f797f8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.598577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f729d-f4f9-4a9d-97e2-460da7f797f8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.600018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 128/244] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:53.602417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 117/245] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:53.605105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f729d-f4f9-4a9d-97e2-460da7f797f8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.606880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfe43-6b2c-4fec-8e20-c3e32df43b62 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.607350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfe43-6b2c-4fec-8e20-c3e32df43b62 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.608112 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbfe43-6b2c-4fec-8e20-c3e32df43b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.629057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-b0bbfe43-6b2c-4fec-8e20-c3e32df43b62 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:53.630333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b0bbfe43-6b2c-4fec-8e20-c3e32df43b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:53.685895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:53.712989 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 118/246] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:53.714252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.714588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.714857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.739967 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:53.741345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:53.743945 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f729d-f4f9-4a9d-97e2-460da7f797f8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.795746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:53.796396 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.796674 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.796947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] PATH_INFO: `/v3/users/e756470d9f9f46269d0c832f41fc8803` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.815353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] RBAC: Authorizing `identity:get_user(user_id=e756470d9f9f46269d0c832f41fc8803)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:53.817400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491397-c033-4a88-a1a8-d0ce8a928c0b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:53.822442 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 129/247] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:53 2022] GET /identity/v3/users/e756470d9f9f46269d0c832f41fc8803 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:53.822442 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:53.822442 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:53.822442 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:53.836143 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 119/248] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:53.837284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:53.851792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:53.854107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:53.865055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:53.946053 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 130/249] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:53.959792 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dfb96-4265-4807-af56-27c02a8a1360 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:53.999767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.000390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.000716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.000996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.065645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.086457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:54.088316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:54.107534 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.145136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.215549 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462cb7c-268b-4b3d-a80c-4fef61cf4045 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.229900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 120/250] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:54.236405 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.262549 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.263198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.263473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.263751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.277395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:54.283599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:54.284728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:54.285601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 131/251] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:07:54.286266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.394265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed48af-dc71-46b4-8433-a20225513faf None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.420719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.437750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.438368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c832e7-e03d-46df-a496-4ea70ce095d8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.438752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.438752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.439006 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.440262 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:54.447958 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:54.449898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 121/252] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:54.455436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.462008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.488123 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.489314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.489881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.490369 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.506029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:54.512042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:54.512966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:07:54.513762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:54.517590 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 132/253] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:54.520807 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.596758 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459b0b-f8d0-43b2-a036-d5cf5590fef1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.636455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.637251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.637541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.637818 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.638544 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:54.638849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:54.640530 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:54.652222 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 122/254] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:54.653096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.656835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286e7e8-7a2c-43d8-92f8-9ad49609f5b1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.704676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.705235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.705510 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.705778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.717749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.723560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:54.728728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:54.729637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:07:54.730493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 133/255] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:54.732479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.777024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:54.781604 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970981a-3481-449c-b8ea-f68d850519e7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.820996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.821615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.822161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.822490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.824220 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=e756470d9f9f46269d0c832f41fc8803) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:54.824540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:54.826214 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:54.834833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 123/256] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/role_assignments?user.id=e756470d9f9f46269d0c832f41fc8803&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:54.843419 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:54.859880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a41f-c98e-45a4-88a4-67b667cde19e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:54.901455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:54.902097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:54.902404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:54.902683 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:54.903364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:54.904307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:54.906143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:54.916078 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 134/257] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:54.916957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.046699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.055865 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53227fa4-7328-46bf-bedc-546c0aa1104a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.072735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dca81-192f-49d5-abc0-ed4fe2551cae None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.102764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.107997 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.108702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.108988 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.109262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.109958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:55.110265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.111898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.122243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 135/258] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:55.123615 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.173879 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.174951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.175418 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.175694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.183217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.184744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.186489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 124/259] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:54 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:55.187314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.272599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882539-9347-47ec-ae0a-38c98fb8bd77 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.359136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.359806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.360088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.360361 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] PATH_INFO: `/v3/users/ac5edf3b8354465897c6f93b6683cae6` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.362037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5edf3b8354465897c6f93b6683cae6)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.366034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.368929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 136/260] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/users/ac5edf3b8354465897c6f93b6683cae6 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:55.369556 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.422826 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5278a-d0cc-4e61-b91c-729e7c24a308 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.431410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.511083 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.511877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.512233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.512505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] PATH_INFO: `/v3/users/b202bc5f52294963888a0a41c0af77ea` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.518713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e3bc4-d35d-435d-861d-d532332bc783 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.519162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] RBAC: Authorizing `identity:get_user(user_id=b202bc5f52294963888a0a41c0af77ea)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.520557 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.522482 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 125/261] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/users/b202bc5f52294963888a0a41c0af77ea => generated 297 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:55.523263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.558022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.559735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.560018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.560288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.602556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.666221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a29f-0cd8-4ecf-9bd7-b21b14b2dccb None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:55.706660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:55.707631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:55.708275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:55.708825 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:55.775124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.776766 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.785951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:55.787647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:55.831936 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.850795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:55.901945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 126/262] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:55.903133 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:55.986095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 137/263] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:07:55.987299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:56.067908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad92a97-3725-4b23-9ac2-2e48a282b455 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.106310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.107453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.107940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.108435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.109882 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.111562 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.114280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 127/264] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:56.115291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:56.136205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164a647-e0fa-40b1-b466-f8e353153b95 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.146737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:56.163678 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:56.172746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.173405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.173657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.173930 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.175130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.176614 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.178274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 138/265] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:55 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:56.179067 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:56.261579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8ea2a-23dd-4599-8fb1-4d1f25dcfdfd None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.343940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.344626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.344900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.345168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.352397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.352397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.352397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 128/266] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:56 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:56.352397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:56.385947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b67c6a-3b9c-4bc3-a295-461b1cf68592 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.457597 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.458582 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.458582 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.458853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/b202bc5f52294963888a0a41c0af77ea/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.465881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, user_id=b202bc5f52294963888a0a41c0af77ea, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.467352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.478789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:56.487931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 139/267] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:56 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/b202bc5f52294963888a0a41c0af77ea/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:07:56.488911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:56.524686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0905b-cf0e-4cec-b603-bdb0e0a3cae6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.610222 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.610956 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.611237 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.611509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.612266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=ac5edf3b8354465897c6f93b6683cae6) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:56.612572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.614129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850c744-d244-4bb7-8081-c90573f0c9e3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.626569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 129/268] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:56 2022] GET /identity/v3/role_assignments?user.id=ac5edf3b8354465897c6f93b6683cae6&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=812192d969e9436d9845f219dd311628 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:56.626758 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:56.694426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aedf5a-e945-497f-b369-02fe629f895b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:56.736985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:56.737601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.737875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.738227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.739012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] RBAC: Adding query filter params (role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=ac5edf3b8354465897c6f93b6683cae6) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:56.739390 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:56.740867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f12600-d38a-48b7-8701-59263b200c47 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:56.748332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 140/269] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:07:56 2022] GET /identity/v3/role_assignments?user.id=ac5edf3b8354465897c6f93b6683cae6&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:56.872234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47317-c960-43d6-bff9-7f9d166f2088 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.872611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47317-c960-43d6-bff9-7f9d166f2088 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.872984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47317-c960-43d6-bff9-7f9d166f2088 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.875866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 130/270] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:56.882700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f6d5-66b6-45ba-b731-c4ed1f58621f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:56.883020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f6d5-66b6-45ba-b731-c4ed1f58621f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:56.883365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59f6d5-66b6-45ba-b731-c4ed1f58621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:56.910993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1c59f6d5-66b6-45ba-b731-c4ed1f58621f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:56.912245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1c59f6d5-66b6-45ba-b731-c4ed1f58621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:57.007298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 141/271] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:57.051377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5c3e-76c5-45bd-b6ee-8c10b6a8408e None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.051730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5c3e-76c5-45bd-b6ee-8c10b6a8408e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.051922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5c3e-76c5-45bd-b6ee-8c10b6a8408e None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.053596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 131/272] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:57.062192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.062494 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.062766 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.083732 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:57.084959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:57.141472 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:57.174777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 142/273] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:07:57.381141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5c3e-76c5-45bd-b6ee-8c10b6a8408e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:57.492665 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5c3e-76c5-45bd-b6ee-8c10b6a8408e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:57.531495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:57.532223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.532505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.532776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.543811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:57.548963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:57.549859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:57.550734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 132/274] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:57.555951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:57.560853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:57.571468 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:57.683066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769cc5a-b255-4475-a6f4-4dd0839e3e93 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:57.711871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab60213-1364-4a47-94a4-3237c3708f15 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:57.745157 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:57.748050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.749167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.750463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.752628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:57.754626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:57.758400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:57.759373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:57.760107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.760446 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.760834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.762223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:57.764670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:57.771433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 133/275] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:07:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:57.772428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:57.779393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 143/276] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:57.790707 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:57.857874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:57.876778 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:57.908333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfad95-1348-4d63-9c26-289b8ae9b63a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:57.951138 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:57.951581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc760897-31d8-4077-9086-ac3e3d6ad387 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:57.951773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:57.952041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:57.952649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:57.953832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:57.956396 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:57.994463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 134/277] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:07:57 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:07:58.013025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:58.013842 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:58.014126 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:58.014428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] PATH_INFO: `/v3/users/0f2da174037646ce81f5ee655d74e763` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:58.034560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f2da174037646ce81f5ee655d74e763)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:58.036736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58645a0f-7ec9-4c86-b6e7-0d813a40dda8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:58.039115 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 144/278] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:57 2022] GET /identity/v3/users/0f2da174037646ce81f5ee655d74e763 => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:07:58.045104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:58.178932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44a7d-f674-4bd5-836a-6151fcbce304 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:58.211392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a479-618e-4fed-8846-d35febca9317 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:58.211717 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a479-618e-4fed-8846-d35febca9317 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:58.211948 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a479-618e-4fed-8846-d35febca9317 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:58.213310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 145/279] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:07:58.218969 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:58.219259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:58.219395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:58.219532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:58.228722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:58.229360 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:58.229637 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:58.229914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:58.230698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, user.id=0f2da174037646ce81f5ee655d74e763, scope.system=all) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:58.231008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:58.232501 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:58.239543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 135/280] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 9 11:07:58 2022] GET /identity/v3/role_assignments?user.id=0f2da174037646ce81f5ee655d74e763&scope.system=all&role.id=a322b06c2e78439baafe5ece304846a2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:58.244297 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:58.246031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:58.340194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 146/281] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:58.699460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:58.884902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19722dc0-cf7e-4cb1-8fc0-142ec2a42b00 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:58.945028 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:58.946722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:58.947494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:58.948347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:58.968660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:07:58.978849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:07:58.980414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:07:58.981773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:07:58.985976 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 136/282] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:07:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:07:58.995857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:59.042560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:59.147065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd6a1-a9a2-407b-a080-c12ad84a24de None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:59.186855 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:59.187837 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.188348 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.188821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.189685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:07:59.190186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:59.193719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:59.203321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 147/283] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:07:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:59.211744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:59.291077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:59.355409 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d365e4-f50d-4146-9f1b-d7c462802d9c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:59.405933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:59.406628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.406915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.407189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] PATH_INFO: `/v3/users/e756470d9f9f46269d0c832f41fc8803` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.408351 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e756470d9f9f46269d0c832f41fc8803)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:59.409866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fef41-e8b4-4dc0-b472-39a797a3e6a3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:59.411785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 137/284] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:07:59 2022] GET /identity/v3/users/e756470d9f9f46269d0c832f41fc8803 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:59.417065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:59.445044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380ae4-9cf7-44d4-8ea7-367bac46d7b0 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.445345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380ae4-9cf7-44d4-8ea7-367bac46d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.445597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6380ae4-9cf7-44d4-8ea7-367bac46d7b0 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.446972 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 138/285] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:07:59.452597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.452881 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.453159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.479338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:07:59.480895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:07:59.546092 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:07:59.557724 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e77f-b9f4-4bcd-8a7b-a8416a12f022 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:59.611598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:59.612592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.613154 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.613626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.615117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:59.617963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:59.620550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 148/286] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:07:59 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:07:59.627058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:07:59.640751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 139/287] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:07:59.751084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584abc9-94d6-45c3-b757-fbbaea6faf35 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:07:59.812928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:07:59.813604 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:07:59.813878 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:07:59.814145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/e756470d9f9f46269d0c832f41fc8803/roles/6dffaef4aeea4b8abb78f313f36a0b91` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:07:59.819118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, user_id=e756470d9f9f46269d0c832f41fc8803, role_id=6dffaef4aeea4b8abb78f313f36a0b91)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:07:59.820788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:07:59.839862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 149/288] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:07:59 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/users/e756470d9f9f46269d0c832f41fc8803/roles/6dffaef4aeea4b8abb78f313f36a0b91 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:00.011307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:00.082291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:00.146159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62409a6-a3e6-4aff-b664-94fc7c6ca56f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:00.198428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:00.199076 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:00.199396 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:00.199663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:00.216126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:00.221014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:00.221889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:00.223378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:00.226484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 140/289] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:00.228545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:00.266775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:00.371484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9715dd9-7b22-44ca-8d97-ad120ab2c0b1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:00.407998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:00.408609 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:00.408887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:00.409158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:00.410378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:00.410676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:00.412041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:00.422818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 150/290] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:00.428647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:00.616527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed90a2-b16d-4521-bb61-2ea28d1aada2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:00.638828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:00.667341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:00.668009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:00.668285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:00.668554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] PATH_INFO: `/v3/users/b202bc5f52294963888a0a41c0af77ea` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:00.669722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] RBAC: Authorizing `identity:get_user(user_id=b202bc5f52294963888a0a41c0af77ea)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:00.671263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:00.673238 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 141/291] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:00 2022] GET /identity/v3/users/b202bc5f52294963888a0a41c0af77ea => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:00.679212 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:00.812842 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:00.839790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f5bf2-8968-4e52-b240-24dc33221286 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:00.887991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:00.889037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:00.889515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:00.889986 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.006778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:01.008277 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d38e32-edab-4f4a-8d49-c6b9fcee2191 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:01.124764 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:01.155330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 151/292] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:01.160934 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:01.236003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81289-d357-4d83-85e0-e977af73bb36 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.236514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81289-d357-4d83-85e0-e977af73bb36 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.236586 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe81289-d357-4d83-85e0-e977af73bb36 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.238096 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 152/293] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:01.243143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7625da3-f9f1-451a-8d10-6e44d72ce173 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.243420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7625da3-f9f1-451a-8d10-6e44d72ce173 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.243689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7625da3-f9f1-451a-8d10-6e44d72ce173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.274672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f7625da3-f9f1-451a-8d10-6e44d72ce173 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:01.275863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f7625da3-f9f1-451a-8d10-6e44d72ce173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:01.287693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5425b-b466-40c6-b871-ac07ddc2aeb1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:01.336852 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:01.337922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.338459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.338924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.340300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:01.342151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:01.344521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 142/294] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:01 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:01.350035 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:01.419214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 153/295] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:01.450940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:01.503458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b796-9c82-4f5c-8be3-a73a2fa9cb63 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.503835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b796-9c82-4f5c-8be3-a73a2fa9cb63 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.503983 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b796-9c82-4f5c-8be3-a73a2fa9cb63 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.505347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 154/296] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:01.510565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.510710 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547e0a-6843-4bd3-8457-d460d100c1e0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:01.510862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.511104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.538626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:01.539814 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:01.561369 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:01.561987 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.562265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.562576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.563307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=b202bc5f52294963888a0a41c0af77ea) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:01.563611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:01.565051 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221fb86-a8a9-4c33-b835-e9c5a020a5ad None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:01.572217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 143/297] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:01 2022] GET /identity/v3/role_assignments?user.id=b202bc5f52294963888a0a41c0af77ea&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=a322b06c2e78439baafe5ece304846a2 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:01.573539 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0e95-31aa-4fa6-98a8-a94316ee8a17 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.573817 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0e95-31aa-4fa6-98a8-a94316ee8a17 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.574089 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a0e95-31aa-4fa6-98a8-a94316ee8a17 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.582377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 144/298] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:01.594808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.595114 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.595347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.627690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:01.630289 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:01.673958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 155/299] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:01.751645 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 145/300] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:01.832160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:01.879610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:01.942804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f867-e4ae-47a3-a1c0-ecafc8f1d399 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:01.983710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:01.984755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:01.985247 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:01.985736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:01.996664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:02.002033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:02.002994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:02.004401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:02.006775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 156/301] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:02.013647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.069930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.086010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.154015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d0708-50c8-42e8-a354-17bfc294cce4 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.195749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.196368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.196550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.196827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.197493 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:02.198341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.199799 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.201982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.204889 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48297b64-c763-40ae-a6cc-1717e10f41f1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.209073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 146/302] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:02.209711 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.247210 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.248168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.248596 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.248929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.259966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:02.264787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:02.265665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:02.266499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 157/303] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:02.267162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.332846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b9acd-1188-42d9-b959-1f2977b7cefb None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.335242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.371008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.371635 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.371951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.372227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] PATH_INFO: `/v3/domains/default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.373484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.375038 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.378511 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 147/304] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:02.378511 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.384153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0058ea-aca3-4d52-a69e-3e591f33938a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.419667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.420291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.420625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.420902 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] PATH_INFO: `/v3/users/0f2da174037646ce81f5ee655d74e763` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.422073 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] RBAC: Authorizing `identity:get_user(user_id=0f2da174037646ce81f5ee655d74e763)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.423540 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.426025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 158/305] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/users/0f2da174037646ce81f5ee655d74e763 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:02.426835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.458930 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.495253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bcf9ef-91e0-4524-a93a-828b9a3f97de None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.530905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.531532 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.531807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.532073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.532766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:02.533065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.535068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.541278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56939255-2fda-47a6-b62e-3880aba99967 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.544895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 148/306] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:02.546043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.580878 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.581556 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.581835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.582107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] PATH_INFO: `/v3/groups` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.583036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.584828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.589893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.614378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 159/307] 10.222.0.25 () {60 vars in 1134 bytes} [Fri Sep 9 11:08:02 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:02.614378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.686961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291947ee-288b-4a45-afeb-5ad34e64ca1b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.728008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.746904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.747298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247542f7-60f1-476f-964c-b272e7ddbe7d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.748203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.749106 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.749634 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] PATH_INFO: `/v3/system/users/0f2da174037646ce81f5ee655d74e763/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.755246 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f2da174037646ce81f5ee655d74e763, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.757768 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.771480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 149/308] 10.222.0.25 () {58 vars in 1334 bytes} [Fri Sep 9 11:08:02 2022] PUT /identity/v3/system/users/0f2da174037646ce81f5ee655d74e763/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:02.796488 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:02.797223 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.797512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.797787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] PATH_INFO: `/v3/users/272e976b130940fb9d51fe9675a038e8` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.817064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] RBAC: Authorizing `identity:get_user(user_id=272e976b130940fb9d51fe9675a038e8)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:02.818659 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe3684-46c8-4a81-94f6-731189d0d9dd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:02.821014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 160/309] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/users/272e976b130940fb9d51fe9675a038e8 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:02.826973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:02.953733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:02.958751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3c55a-702e-4000-99d1-9d4331af038d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:02.993810 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb337-7b03-4334-b9ec-6a81684c674a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:02.994011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb337-7b03-4334-b9ec-6a81684c674a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:02.994254 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbb337-7b03-4334-b9ec-6a81684c674a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:02.995760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 161/310] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:03.001473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:03.001751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:03.002024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:03.005255 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:03.005872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:03.006154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:03.006567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:03.007249 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, user.id=272e976b130940fb9d51fe9675a038e8, scope.system=all) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:03.007605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:03.009029 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:03.015061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 150/311] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 9 11:08:02 2022] GET /identity/v3/role_assignments?user.id=272e976b130940fb9d51fe9675a038e8&scope.system=all&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:03.027522 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:03.028776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:03.113042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 162/312] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:03.437894 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:03.552285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312fd48-c8ae-4f6e-ad1a-e556405c4713 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:03.593811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:03.594485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:03.594762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:03.595029 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:03.606303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:03.611742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:03.612736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:03.613533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 151/313] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:03.619029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:03.697839 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:03.722069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca354cf-6385-4841-b6c5-6c5b4b2628de None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:03.757719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:03.758405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:03.758680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:03.759098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:03.759765 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:03.760065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:03.761421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:03.771222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 163/314] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:03.777339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:03.820510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:03.923140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32359d0-9c83-40c2-935c-21255cfa2e69 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:03.963162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:03.964169 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:03.964649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:03.965117 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] PATH_INFO: `/v3/users/e756470d9f9f46269d0c832f41fc8803` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:03.966554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] RBAC: Authorizing `identity:get_user(user_id=e756470d9f9f46269d0c832f41fc8803)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:03.968216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:03.970326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 152/315] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:03 2022] GET /identity/v3/users/e756470d9f9f46269d0c832f41fc8803 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:03.980507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:04.087661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13877037-5863-4cbb-abb5-658c2403c7f2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:04.126017 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:04.126662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:04.126939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:04.127209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:04.137091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:04.205322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:04.208140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:04.321003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 164/316] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:04.326758 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:04.424436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:04.444272 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9ac4c-2e1f-4384-9676-12b4cc0b67fc None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:04.481363 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:04.482276 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:04.482728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:04.483166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:04.484477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:04.486061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb3f03-76a5-48e4-9905-22a0c8ff2ebc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:04.488764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 153/317] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:04 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:04.494413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:04.537162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:04.604278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1d2c-ff94-42e9-a3fd-3e964f4f2340 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:04.638845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:04.639498 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:04.639716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:04.639984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:04.640707 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d, user.id=e756470d9f9f46269d0c832f41fc8803) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:04.641010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:04.642480 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19609e-41ac-470e-9287-582c2c3b8b4f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:04.649360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 165/318] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:04 2022] GET /identity/v3/role_assignments?user.id=e756470d9f9f46269d0c832f41fc8803&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:05.218835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9d41-6249-43a7-8e8e-8875f10d1109 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.219546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9d41-6249-43a7-8e8e-8875f10d1109 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.220023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9d41-6249-43a7-8e8e-8875f10d1109 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.221538 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 154/319] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:05.227245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab04ea-6091-475f-8ebe-f5cf9bda7e91 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.227530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab04ea-6091-475f-8ebe-f5cf9bda7e91 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.227805 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab04ea-6091-475f-8ebe-f5cf9bda7e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.246613 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-5cab04ea-6091-475f-8ebe-f5cf9bda7e91 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:05.247803 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5cab04ea-6091-475f-8ebe-f5cf9bda7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:05.318734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 166/320] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:05.433502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d573d-cf7f-4bfd-b828-e785b6cc4531 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.433502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d573d-cf7f-4bfd-b828-e785b6cc4531 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.433502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d573d-cf7f-4bfd-b828-e785b6cc4531 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.433502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 155/321] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:05.438790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.439074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.439349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.460091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb918-e78b-41d0-ade2-d14d2e687b56 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.460602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:05.460679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb918-e78b-41d0-ade2-d14d2e687b56 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.460679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb918-e78b-41d0-ade2-d14d2e687b56 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.461275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:05.462088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 156/322] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:05.467380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.467871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.468337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.486860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:05.488513 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:05.493964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:05.542970 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 167/323] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:05.562025 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 157/324] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:05.639066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:05.741210 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b38b5c-324f-4807-b51a-65bda57ad77b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:05.783230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:05.783869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.784824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.785098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.786299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:05.787812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:05.789543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 168/325] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:05.795015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:05.872667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:05.892091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:05.904693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:05.905578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6f24-1e4b-445d-847e-190d01cb8a97 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:05.940555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:05.941427 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:05.941733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:05.942006 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] PATH_INFO: `/v3/groups` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:05.942743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:05.944483 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:05.960984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 158/326] 10.222.0.25 () {60 vars in 1134 bytes} [Fri Sep 9 11:08:05 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:05.961797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:05.989430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5498f-fc95-463a-912b-44cbc40519cc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.029395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.029952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.030337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.030852 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.044706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:06.051399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:06.052619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:06.054081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 169/327] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:06.058626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.092623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c1fc-43b8-4c7e-a275-c51a7b5fc381 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.140093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.141442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.142764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.143042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.155622 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:06.161785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:06.163128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:06.164273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 159/328] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:06.168587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:06.168965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.179714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91480bf-a498-434d-afc8-00843f3b782c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.180977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:06.230096 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.231112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.231591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.232033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.232855 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:06.233317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.234745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.243638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 170/329] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:06.249080 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.289951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfed48-c2c3-4286-9b44-a49e4fe9c1b8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.328310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.329072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.329348 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.329616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.330283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:06.330721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.332845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.342452 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 160/330] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:06.350108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.390172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72ea2c-99e3-4c8e-b047-4aa9ca5491ad None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.437627 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.438260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.438566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.438834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] PATH_INFO: `/v3/users/272e976b130940fb9d51fe9675a038e8` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.440033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] RBAC: Authorizing `identity:get_user(user_id=272e976b130940fb9d51fe9675a038e8)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.442433 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.444087 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 171/331] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:06 2022] GET /identity/v3/users/272e976b130940fb9d51fe9675a038e8 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:06.446841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:06.450403 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.479195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:06.492373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5535e8-299a-491e-98b5-b0440f96746e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.535200 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.538462 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.538997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.539470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] PATH_INFO: `/v3/users/0f2da174037646ce81f5ee655d74e763` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.541025 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] RBAC: Authorizing `identity:get_user(user_id=0f2da174037646ce81f5ee655d74e763)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.542716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.544898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 161/332] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:06 2022] GET /identity/v3/users/0f2da174037646ce81f5ee655d74e763 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:06.555380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:06.579881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338ade-75da-4448-9430-21abe79f8a0c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.641541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.642194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.642520 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.642794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] PATH_INFO: `/v3/system/users/272e976b130940fb9d51fe9675a038e8/roles/6dffaef4aeea4b8abb78f313f36a0b91` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.644881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=272e976b130940fb9d51fe9675a038e8, role_id=6dffaef4aeea4b8abb78f313f36a0b91)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.646402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80400f1c-0e01-4332-b203-ccc338d7b7f6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.657967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 172/333] 10.222.0.25 () {58 vars in 1334 bytes} [Fri Sep 9 11:08:06 2022] PUT /identity/v3/system/users/272e976b130940fb9d51fe9675a038e8/roles/6dffaef4aeea4b8abb78f313f36a0b91 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:06.716774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9a093-53c3-4b85-b29d-743ccd9c435b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:06.758877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:06.759570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:06.759845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:06.760208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:06.760946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] RBAC: Adding query filter params (role.id=a322b06c2e78439baafe5ece304846a2, user.id=0f2da174037646ce81f5ee655d74e763, scope.system=all) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:06.761250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:06.762885 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb928ef3-606d-4cc4-8f1b-cc965f54264c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:06.770719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:06.778033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 162/334] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 9 11:08:06 2022] GET /identity/v3/role_assignments?user.id=0f2da174037646ce81f5ee655d74e763&scope.system=all&role.id=a322b06c2e78439baafe5ece304846a2 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:08.741845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abeaf-c2de-46cb-bc93-06c941d8458c None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:08.742374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abeaf-c2de-46cb-bc93-06c941d8458c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:08.742374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abeaf-c2de-46cb-bc93-06c941d8458c None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:08.743939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 173/335] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:08.749601 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cbf70-29bd-471d-b982-d1471f90d86c None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:08.750060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cbf70-29bd-471d-b982-d1471f90d86c None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:08.750151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cbf70-29bd-471d-b982-d1471f90d86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:08.772215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-d30cbf70-29bd-471d-b982-d1471f90d86c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:08.773427 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d30cbf70-29bd-471d-b982-d1471f90d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:08.856295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 163/336] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:09.005397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d517a9-ddeb-4c3d-b311-c8953cc39aa6 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:09.005995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d517a9-ddeb-4c3d-b311-c8953cc39aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:09.006534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d517a9-ddeb-4c3d-b311-c8953cc39aa6 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:09.008081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 174/337] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:09.013829 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:09.014401 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:09.014873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:09.035310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:09.036850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:09.114476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 164/338] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:09.327931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d517a9-ddeb-4c3d-b311-c8953cc39aa6 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:09.423734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:09.445835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d517a9-ddeb-4c3d-b311-c8953cc39aa6 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:09.481719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:09.482375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:09.482681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:09.482953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:09.494771 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:09.499546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:09.500605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:09.501578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 175/339] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:09.507347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:09.527430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:09.659722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:09.736976 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217fc3-e678-40d6-8ec2-ba9734075582 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:09.772110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321c2ce-2c66-46fa-835c-ef7696b87810 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:09.807471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:09.808126 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:09.808391 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:09.808661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:09.813675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:09.814288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:09.814600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:09.814922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:09.816355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:09.816661 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:09.818046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:09.825303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:09.830266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 165/340] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:09.836658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:09.837794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:09.838697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:09.839473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 176/341] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:09.852991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:09.858694 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.011155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a86fd8-e4df-4098-a40c-c4a0e5e3aa98 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:10.041387 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.057892 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a847-9c7f-45b1-9f26-1010c80ce5ba None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:10.078752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:10.079377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.079717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.079970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.129311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:10.130280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.130801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.131260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.132283 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:10.133598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:10.139114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734fcff-55e3-4549-aa7c-1d52d70fd230 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:10.152908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 177/342] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:10.154534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f788553-f001-4b9f-afe7-33195cdd7dec None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.155010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f788553-f001-4b9f-afe7-33195cdd7dec None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.155481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f788553-f001-4b9f-afe7-33195cdd7dec None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.157093 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 178/343] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:10.164431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.164989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.165459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.180213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:10.181687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:10.197990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:10.199997 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:10.302009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.313435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 179/344] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:10.314611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:10.436484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 166/345] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:08:10.447458 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:10.460527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9e34-6162-4d66-ab49-94290e4c0eea None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:10.491832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.524628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:10.525252 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.525524 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.525788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.664997 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.679625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:10.681089 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:10.731610 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237e0bc-a43f-46b1-8f90-265fcc52c333 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:10.791054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:10.791691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.791951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.792221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.793452 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:10.795030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cee47-5537-4b57-8bd5-4231352dee94 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:10.797120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 167/346] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:10 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:10.798261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d872-f82f-4b30-b7a5-aaee94dfe5e8 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:10.798559 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d872-f82f-4b30-b7a5-aaee94dfe5e8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:10.798828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4d872-f82f-4b30-b7a5-aaee94dfe5e8 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:10.800362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 168/347] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:10.801113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d872-f82f-4b30-b7a5-aaee94dfe5e8 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:10.839924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 180/348] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:10.840589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:10.916278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.942151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4d872-f82f-4b30-b7a5-aaee94dfe5e8 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:10.948060 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:10.959849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c827-f8f1-491d-aba7-9ca9e5589f5a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.004459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.005097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.005376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.005644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.008205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.009053 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.009534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.010005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.016762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.019285 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f6cde-c8f8-4b86-bbca-5696f13d42a7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.021461 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 181/349] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:10 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.021697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:11.023228 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.023703 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.024158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:11.027810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:11.028705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:11.029516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 169/350] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:11.035837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.047055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:11.048620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:11.124260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 182/351] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:11.125536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.143357 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e348ebd-faab-4da3-a79d-df510245762a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.181534 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.182265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.182573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.182841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.183960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.185617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.188492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 170/352] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.189452 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.207210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:11.237245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:11.249766 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df1f2c-2c96-491c-835d-46e5e127c271 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.287660 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.288669 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.289189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.289754 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.290730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:11.291281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.293111 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.300672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 183/353] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=a322b06c2e78439baafe5ece304846a2 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.301971 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.304904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b44cca-28c0-471b-83f9-d9f50507c5c6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.345970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.346713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.346991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.347256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.347917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:11.348209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.349584 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.359349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 171/354] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.366045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.421290 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48441892-b386-4741-9894-e243c8a8b481 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.459580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:11.477426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.478502 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.479023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.479592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.481110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.482931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605267e-6db4-4d11-8f83-8b5385fb01c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.485020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 184/355] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.487097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7939db2-7324-451b-9335-0ac052c3b494 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.487212 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f00b7-a3f9-4cbf-90c7-d482bb180c1b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.487677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7939db2-7324-451b-9335-0ac052c3b494 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.488220 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7939db2-7324-451b-9335-0ac052c3b494 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.489919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 185/356] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:11.495885 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.496493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.496954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.525094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.525505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:11.525723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.525998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.526267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] PATH_INFO: `/v3/users/272e976b130940fb9d51fe9675a038e8` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.527433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=272e976b130940fb9d51fe9675a038e8)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.527841 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:11.528860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.530865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 172/357] 10.222.0.25 () {56 vars in 1177 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/users/272e976b130940fb9d51fe9675a038e8 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:11.532367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.554974 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:11.630616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 186/358] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:11.631400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.650902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af0fd-d95e-4f28-8d6d-bad0d1ddd3e7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.692843 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.693377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.693650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.693918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.694698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:11.695006 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.696485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.705680 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 173/359] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.754260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:11.767666 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:11.782286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117182-0e16-4008-b56a-75bd134cfa8f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.862651 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.863310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.863536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.863846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:11.864569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] RBAC: Adding query filter params (role.id=6dffaef4aeea4b8abb78f313f36a0b91, user.id=272e976b130940fb9d51fe9675a038e8, scope.system=all) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:11.864923 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:11.867222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:11.892716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 187/360] 10.222.0.25 () {56 vars in 1308 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/role_assignments?user.id=272e976b130940fb9d51fe9675a038e8&scope.system=all&role.id=6dffaef4aeea4b8abb78f313f36a0b91 => generated 510 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:11.937693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8917b-b7a8-4630-864c-59ddd9f1ebc5 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:11.990982 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:11.991549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:11.991822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:11.992088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.008936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:12.014337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:12.015273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:12.016180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 174/361] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:12.021965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.035961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:12.067781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.182104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a31f-be84-4202-9486-eabf14c6a522 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:12.211685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:12.255673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:12.256213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.256491 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.256762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.257428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:12.257733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:12.260698 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:12.275972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 188/362] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:12.282678 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.285550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b1c43-e707-422e-90ce-99a6b2e9ccaf None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:12.362269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:12.363052 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.363318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.363591 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.382926 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:12.389404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:12.390339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:12.391170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 175/363] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:12.396572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.477541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:12.499584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b9680-5ddf-407f-85c4-b2bfd6d10247 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:12.542411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:12.542945 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.543226 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.543499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.621171 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266523ea-586c-4d4e-b4d3-7596ae27e700 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:12.665448 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:12.667318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af171e-8832-4a7f-8e15-9df3868427c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:12.671254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:12.683165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:12.684239 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.684690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.685354 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.686814 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:12.687289 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:12.689332 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f72226-610d-4e58-8bbf-39049e3b6c5a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:12.702165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 176/364] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:12.703971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876414d6-535f-4c96-9899-890c6589bf67 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.704876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876414d6-535f-4c96-9899-890c6589bf67 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.706103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876414d6-535f-4c96-9899-890c6589bf67 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.707916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 177/365] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:12.708902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876414d6-535f-4c96-9899-890c6589bf67 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.755057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:12.803792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 189/366] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:12.806490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.806968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.807417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.831642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:12.833944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:12.841114 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876414d6-535f-4c96-9899-890c6589bf67 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:12.881399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:12.882303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:12.882683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:12.883023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:12.926536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 190/367] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:12.928224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:12.998730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.018611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.020083 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.132174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c664e-4461-4725-8c25-86d2807aed6b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.133750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.194688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.195800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.196266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.196744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.198515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 178/368] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:13.199304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.200775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.202382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 191/369] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:12 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.208743 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.208876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.330569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fde15-f505-4ed9-a044-50a3aebb4670 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.366629 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.367267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.367541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.367802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.368908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.370316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.372176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 192/370] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.377728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.424375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.427052 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.458741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5528e1-e338-4966-8bd7-844253ca74d8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.489412 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b15097-749b-40d6-9cf8-0156a02a66d2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.501906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.503576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.504108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.504570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.505989 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.507977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.510340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 179/371] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.511372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.534039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.534873 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.535148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.535418 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.536644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.538244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.540364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 193/372] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.541205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.624954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac75756-c897-4860-bcba-18e9434d6c6a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.654629 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9674a7-488f-4aee-ba59-05abf9352206 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.663612 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.666527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.667585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.667916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.668374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.681027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:13.687078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:13.687948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:13.688809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:13.691927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 180/373] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:13.693215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.694898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.695040 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.695254 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.695521 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.696293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:13.696693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.698107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.704588 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 194/374] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=a322b06c2e78439baafe5ece304846a2 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.706458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.719186 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:13.822958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a2004-d008-4bc1-98f8-a5be8f96aecb None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.862704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.863794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.864361 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.864873 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.865757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:13.866275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.868046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.873361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1596-e51b-4f81-a7ef-47aa10e04c41 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:13.878483 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 195/375] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.886035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:13.943018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:13.944355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:13.944836 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:13.945294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:13.946308 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:13.946835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:13.949389 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:13.956549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 181/376] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:13.977794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:14.073414 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0f31-285d-4c32-802a-fc719b6e00a6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:14.116353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:14.117056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.117338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.117752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.208932 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:14.210316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d134ed7-e6ac-4633-978b-5bbe8eaee111 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:14.244938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:14.327665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 196/377] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:14.333518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:14.470984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:14.492991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638ce48-97f6-4292-888e-ac6fabfff575 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:14.496179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0706-f0e0-46b0-9182-b8c65e4f6d87 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.496533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0706-f0e0-46b0-9182-b8c65e4f6d87 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.496875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a0706-f0e0-46b0-9182-b8c65e4f6d87 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.498640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 197/378] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:14.504038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.504401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.504740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.531058 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:14.532007 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.532467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.532937 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] PATH_INFO: `/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.535002 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] RBAC: Authorizing `identity:get_project(project_id=aa345ead696a4e8d96d7636f92ce2f5c)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:14.536749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:14.539068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 182/379] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:14 2022] GET /identity/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:14.542726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:14.543995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:14.545148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:14.672830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 198/380] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:14.708111 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2de61-7601-4841-8580-aaa52a00dc2d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:14.742807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:14.743746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.744024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.744293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] PATH_INFO: `/v3/groups/d2008423d67d453fbb18b72c3a7defc2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.750295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] RBAC: Authorizing `identity:get_group(group_id=d2008423d67d453fbb18b72c3a7defc2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:14.751832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec607a8-30b4-4708-b69a-13cd54e24108 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:14.753783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 183/381] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:14 2022] GET /identity/v3/groups/d2008423d67d453fbb18b72c3a7defc2 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:14.759646 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:14.835708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:14.890468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37bdb4-4f9e-41d6-a7db-d9ddd5dd4399 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:14.939061 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:14.939734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.940260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.940531 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.941308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] RBAC: Adding query filter params (group.id=d2008423d67d453fbb18b72c3a7defc2, role.id=812192d969e9436d9845f219dd311628, scope.project.id=aa345ead696a4e8d96d7636f92ce2f5c) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:14.941607 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:14.943050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cd670-5519-40f1-b880-44d45923bf86 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:14.948985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 199/382] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:14 2022] GET /identity/v3/role_assignments?group.id=d2008423d67d453fbb18b72c3a7defc2&scope.project.id=aa345ead696a4e8d96d7636f92ce2f5c&role.id=812192d969e9436d9845f219dd311628 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:14.982647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e050f-d9dd-4d67-8004-751eaf77c707 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.982962 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e050f-d9dd-4d67-8004-751eaf77c707 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.983200 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e050f-d9dd-4d67-8004-751eaf77c707 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:14.984837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 184/383] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:14.992012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:14.992540 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:14.992626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:15.014034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:15.015301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:15.092522 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 200/384] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:15.417622 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e050f-d9dd-4d67-8004-751eaf77c707 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:15.427839 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:15.447283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:15.491362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:15.535550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa66e-712b-40d1-8b4b-bb8c18621426 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:15.577594 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:15.578232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:15.578542 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:15.578814 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:15.590994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:15.591970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e050f-d9dd-4d67-8004-751eaf77c707 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:15.596023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:15.596927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:15.597708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 201/385] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:15.605761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:15.647967 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:15.648610 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:15.648894 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:15.649170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:15.664796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:15.669694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:15.670589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:15.671379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:15.679005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 185/386] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:15.685631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:15.721699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff902-d510-4102-a51f-5080ea47f21b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:15.750736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:15.763796 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:15.764405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:15.764681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:15.764946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:15.765601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:15.765898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:15.767286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:15.780186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 202/387] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:15.785044 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:15.830869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:15.887544 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106ec72-2252-4add-9306-c328f0563f0e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:15.962009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:15.962629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:15.962911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:15.963206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:15.966179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:15.966571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:15.971437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:15.989439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 186/388] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:15.992284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3703e5-08fd-4138-acb6-cd0a1a58ccc7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:15.996432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:16.063260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.063899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.064733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.065269 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.074379 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.075835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.077519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 203/389] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:16.090987 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:16.158745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:16.211272 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ffc9e-006d-4212-a6d8-62be25ef0755 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:16.230934 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936b36-5b37-4e44-bb41-c2341db1fee0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:16.273922 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.274593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.274871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.275140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.277525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.278988 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.280764 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 204/390] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:16 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:16.287331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:16.304867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.305516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.305794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.306064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.308832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.310289 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.312406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 187/391] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:15 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:16.318904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:16.324569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:16.460168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c225734-ddd1-412f-96ca-02a2bf9191ed None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:16.466774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8d3de-6bba-455e-b04a-bbc983d57508 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:16.489153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:16.506639 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.507355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.507690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.507906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.509940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.512170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.516751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 188/392] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:16 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:16.523499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:16.542473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.543173 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.543496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.543767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/groups/27013c5b00a349e0977d697ab9280760/roles/6c1bfab1b76347f9a793a9ae11e773e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.549238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, group_id=27013c5b00a349e0977d697ab9280760, role_id=6c1bfab1b76347f9a793a9ae11e773e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.550770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917207c-d4c0-4dee-b10d-5b6b5710249a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.577893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 205/393] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 9 11:08:16 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/groups/27013c5b00a349e0977d697ab9280760/roles/6c1bfab1b76347f9a793a9ae11e773e1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:16.641690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:16.686868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf5f1-ff2a-410a-bc90-adfe569b0c1e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:16.732769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:16.733443 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:16.733724 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:16.733997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/groups/27013c5b00a349e0977d697ab9280760/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:16.736483 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ba7ced80ac940b69e812f0e787af1e1, group_id=27013c5b00a349e0977d697ab9280760, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:16.737966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8c858-2033-4498-82c9-a7f8a5d4dca6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:16.756157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 189/394] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 9 11:08:16 2022] PUT /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1/groups/27013c5b00a349e0977d697ab9280760/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:08:17.055187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcc7ab-fe2f-4122-9195-fc81c3ffcdf2 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.055679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcc7ab-fe2f-4122-9195-fc81c3ffcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.055679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcc7ab-fe2f-4122-9195-fc81c3ffcdf2 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.056964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 206/395] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:17.072068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01650-127f-4f40-97ae-35751c3b7130 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.072692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01650-127f-4f40-97ae-35751c3b7130 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.073168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01650-127f-4f40-97ae-35751c3b7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.097453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-adc01650-127f-4f40-97ae-35751c3b7130 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:17.098968 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-adc01650-127f-4f40-97ae-35751c3b7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:17.175188 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 190/396] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:17.201911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffbd4-e985-48b3-a07f-6f82ae84c4f5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.202552 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffbd4-e985-48b3-a07f-6f82ae84c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.203019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffbd4-e985-48b3-a07f-6f82ae84c4f5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.204830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 207/397] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:17.210520 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.211072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.211543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.234790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:17.236840 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:17.300406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:17.315246 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 191/398] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:17.552054 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffbd4-e985-48b3-a07f-6f82ae84c4f5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:17.670877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffbd4-e985-48b3-a07f-6f82ae84c4f5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:17.708125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:17.708813 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.709088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.709401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.721961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:17.727385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:17.728332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:17.729120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 208/399] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:17.734476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:17.754221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:17.810738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:17.912344 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1d68-20a5-4cc4-af2f-546165b4427e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:17.934571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6528-d9e5-4f53-95f4-50d443188a0c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:17.989612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:17.990226 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:17.990547 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:17.990807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:17.991480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:17.991780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:17.993162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.006383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.007058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.007336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.007605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.012506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 192/400] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:18.019065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.031850 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:18.037792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:18.038692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:18.040266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 209/401] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:18.046509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.128009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:18.180000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eee26-fabb-462a-af96-4e121700b3dc None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.217550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.218436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.218861 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.219284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.221179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.223023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.224776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 193/402] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:18.230917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.260605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:18.276392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae548b4-1e14-406d-811e-ddb43c98f209 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.361335 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ea3a5-2688-426d-befc-6c8684519373 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.372225 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.373209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.373628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.374054 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.374881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:18.375322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.377382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.388269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:18.396770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 210/403] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:18.402858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.403172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.404026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.404505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.404969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.406364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.408630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b49df-2373-4c74-a47a-05eec3fd5aa6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.412165 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 194/404] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:18.413988 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19b26-3d23-4a7d-85e6-1eb11a40b7c1 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.414583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19b26-3d23-4a7d-85e6-1eb11a40b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.415245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19b26-3d23-4a7d-85e6-1eb11a40b7c1 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.417288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 195/405] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:18.424096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.424374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.424650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.447416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:18.454372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:18.554065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 196/406] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:18.555415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.569785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7058b-b229-4170-8f91-0f26ba80692b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.613394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.614058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.614536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.614815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.616320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.618214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.620465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 211/407] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:18.626032 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.671979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:18.708586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a182b-597f-49f3-b17d-c0975727f1f8 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.744201 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:18.776044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.776707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.776979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.777247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/groups/27013c5b00a349e0977d697ab9280760/roles/6c1bfab1b76347f9a793a9ae11e773e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.784699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, group_id=27013c5b00a349e0977d697ab9280760, role_id=6c1bfab1b76347f9a793a9ae11e773e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.786257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.791734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1fb9-3308-45d8-8a4c-1fdaec9d3d1a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:18.810556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 197/408] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 9 11:08:18 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/groups/27013c5b00a349e0977d697ab9280760/roles/6c1bfab1b76347f9a793a9ae11e773e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:18.829382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:18.830588 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:18.830865 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:18.831136 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:18.832400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:18.833832 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:18.835877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 212/409] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:18.843893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.961416 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:18.975987 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4ecf-a312-425f-9a30-96c95c08f963 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.033189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.033876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.034155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.034467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/groups/27013c5b00a349e0977d697ab9280760/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.039769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] RBAC: Authorizing `identity:create_grant(project_id=50fc052af41346f5bf0f830b9ab81f5d, group_id=27013c5b00a349e0977d697ab9280760, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:19.041291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:19.069731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 198/410] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 9 11:08:18 2022] PUT /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d/groups/27013c5b00a349e0977d697ab9280760/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:19.073332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:19.087198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b20b-7468-4cff-80e8-f67434d2bea5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.128637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.129520 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.129939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.130427 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.143374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:19.148709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:19.149824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:19.150838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:19.153365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 213/411] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:19.159498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:19.219250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:19.302981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33fa11-fbdd-4bee-bc46-2dc4aa01f270 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.356029 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.356644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.356932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.357201 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.357878 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:19.358177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:19.359593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:19.369979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 199/412] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:19.375374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:19.531496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0873894-9667-4ce9-be29-3d4ec9487e89 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.569359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.570406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.570880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.571341 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] PATH_INFO: `/v3/groups/d2008423d67d453fbb18b72c3a7defc2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.572653 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] RBAC: Authorizing `identity:get_group(group_id=d2008423d67d453fbb18b72c3a7defc2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:19.574266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:19.576293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 214/413] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:19 2022] GET /identity/v3/groups/d2008423d67d453fbb18b72c3a7defc2 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:19.583451 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:19.720704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67097be-8556-46ff-848d-bc046615d0d1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.727922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:19.757228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.757982 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.758124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.758378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] PATH_INFO: `/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.759537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] RBAC: Authorizing `identity:get_project(project_id=aa345ead696a4e8d96d7636f92ce2f5c)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:19.760953 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5641-2edf-408c-9def-5aef2decec3e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:19.762591 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 200/414] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:19 2022] GET /identity/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:19.768548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:19.799174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:19.895805 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079945b-a008-43b5-bfab-1019ce8fd3e4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:19.940807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca7de0-5ab6-4f41-88a7-57a499c86d65 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.941141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca7de0-5ab6-4f41-88a7-57a499c86d65 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.941351 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca7de0-5ab6-4f41-88a7-57a499c86d65 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.942772 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 201/415] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:19.946599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:19.947850 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.948355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.948477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef0ed-c3c5-4916-b986-e6fca99c3881 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:19.948670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef0ed-c3c5-4916-b986-e6fca99c3881 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:19.948938 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef0ed-c3c5-4916-b986-e6fca99c3881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.949344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] PATH_INFO: `/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c/groups/d2008423d67d453fbb18b72c3a7defc2/roles/812192d969e9436d9845f219dd311628` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:19.951572 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa345ead696a4e8d96d7636f92ce2f5c, group_id=d2008423d67d453fbb18b72c3a7defc2, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:19.953171 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf509a0-bbcc-49e4-b5cf-56d6c064ae79 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:19.969111 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-7ebef0ed-c3c5-4916-b986-e6fca99c3881 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:19.971049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-7ebef0ed-c3c5-4916-b986-e6fca99c3881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:19.981289 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 215/416] 10.222.0.25 () {58 vars in 1442 bytes} [Fri Sep 9 11:08:19 2022] PUT /identity/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c/groups/d2008423d67d453fbb18b72c3a7defc2/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:20.068639 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 202/417] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:20.080046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a454-293f-4067-9d0d-f6e1875179f7 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:20.080555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a454-293f-4067-9d0d-f6e1875179f7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:20.081003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7a454-293f-4067-9d0d-f6e1875179f7 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:20.082551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 216/418] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:20.089107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:20.089406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:20.089662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:20.119723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:20.120997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:20.221901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 203/419] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:20.514423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a454-293f-4067-9d0d-f6e1875179f7 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:20.622381 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:20.652112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7a454-293f-4067-9d0d-f6e1875179f7 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:20.703082 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:20.703740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:20.704026 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:20.704376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:20.715885 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:20.720714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:20.721700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:20.722529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 217/420] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:20.730095 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:20.731503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:20.766383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:20.886142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b764-738c-435c-a26b-aa02f42a7233 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:20.924143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d92bdd-bd87-4341-b701-2a61c6afe8e9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:20.960638 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c697-204c-4752-8116-9eac2829862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:20.964633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c697-204c-4752-8116-9eac2829862a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:20.965124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c697-204c-4752-8116-9eac2829862a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:20.965596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c697-204c-4752-8116-9eac2829862a None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:20.966524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c697-204c-4752-8116-9eac2829862a None admin] RBAC: Adding query filter params (name=member) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:20.967023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c697-204c-4752-8116-9eac2829862a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:20.968593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c697-204c-4752-8116-9eac2829862a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:20.987044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 204/421] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:20.994336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c697-204c-4752-8116-9eac2829862a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.008196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.008863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.009134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.009397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.032275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.040175 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:21.049059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:21.050070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:21.050911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:21.051506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 218/422] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:21.059334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.197540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.213454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c697-204c-4752-8116-9eac2829862a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.249230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a045b-3cb2-4f04-aefa-052c808b5fb3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.290033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.291039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.291547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.292151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.293027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:21.293161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.293654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.293870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:21.293981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.294226 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.296078 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:21.306046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 219/423] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:21.312562 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.377410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.418867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9d01-c000-4bed-a9b0-c9a8d1d97ff6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.428728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:21.430367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:21.473162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.474401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.474920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.475425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.552637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:21.555431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:21.627268 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.633114 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.656592 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 205/424] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:21.658412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.670525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 220/425] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:08:21.677208 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.793819 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466977-3b32-4d9c-86a1-1166d7440b12 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.834862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.835561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.835845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.836175 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.837456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:21.839164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:21.841202 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 221/426] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:21.847271 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:21.884145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:21.913014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c5cf0-6a38-4d3c-bd06-54958e3accb5 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.962330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:21.963429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.963715 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.963992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] PATH_INFO: `/v3/projects/4ba7ced80ac940b69e812f0e787af1e1` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.965359 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] RBAC: Authorizing `identity:get_project(project_id=4ba7ced80ac940b69e812f0e787af1e1)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:21.967501 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafa631-44f1-4016-ace6-d37e88cf2133 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:21.969436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 206/427] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/projects/4ba7ced80ac940b69e812f0e787af1e1 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:21.970735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c6f1-059c-47a0-84be-e3e95484989f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:21.970847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ae31-113b-47d2-ba03-e5ad8edb2009 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:21.971057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ae31-113b-47d2-ba03-e5ad8edb2009 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:21.971331 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ae31-113b-47d2-ba03-e5ad8edb2009 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:21.972513 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 207/428] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:21.977478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ae31-113b-47d2-ba03-e5ad8edb2009 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:22.012283 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:22.013274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.013758 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.014216 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.015779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:22.017915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79093db8-6ed6-486d-bce5-22e0ed585b98 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:22.019728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 222/429] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:22.021117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.021658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.022117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.043294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:22.044829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:22.065965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:22.134664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ae31-113b-47d2-ba03-e5ad8edb2009 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:22.135038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 223/430] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:22.136113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:22.174312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:22.175007 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.175288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.175557 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.177030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:22.178587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:22.181074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 208/431] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:21 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:22.186649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:22.197212 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:22.323503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392254fb-2c9a-4e73-a80f-b80ae38c15dd None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:22.327675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08272fcb-ab02-411d-9c83-7d362144509c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:22.359620 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:22.365960 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:22.366867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.367316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.367912 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.368878 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:22.369031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:22.369539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:22.369777 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.370123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.370491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.371286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=4ba7ced80ac940b69e812f0e787af1e1) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:22.371655 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:22.372093 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:22.373178 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f986f68-0159-4852-868e-7f10bd807c12 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:22.386472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 209/433] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:22 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=a322b06c2e78439baafe5ece304846a2 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:22.386472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519728-db7f-4290-880f-ac808c5e1a0d None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.386472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519728-db7f-4290-880f-ac808c5e1a0d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.386472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad519728-db7f-4290-880f-ac808c5e1a0d None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.386472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 210/434] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:22.386959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 224/434] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:22 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=4ba7ced80ac940b69e812f0e787af1e1&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:22.400403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.400730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.400943 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.439016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:22.440798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:22.580545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 211/435] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:22.680229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:22.787045 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:22.799178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b27ed-2369-4b79-83e2-589059ba28c5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:22.844059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:22.844723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:22.845000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:22.845266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:22.857536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:22.862864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:22.864023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:22.864935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 225/436] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:22.870794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:22.925862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.005635 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5ed52-4cb4-4620-9741-93e58f7423cc None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.033834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.053025 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.054163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.054540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.054893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.055658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:23.056041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.057725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b2c18-9872-4d83-ac70-16f1d6ca2d35 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.066779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade67c71-0de4-43bf-997a-07e0c2a245ac None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.073679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 212/437] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:23.073679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8235e-d3e5-44fd-8362-56c94ec97f85 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.073679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8235e-d3e5-44fd-8362-56c94ec97f85 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.073679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8235e-d3e5-44fd-8362-56c94ec97f85 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.073679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 213/438] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:23.079825 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8235e-d3e5-44fd-8362-56c94ec97f85 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.111661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.112489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.112761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.113035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.126304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f3214122-eda3-4b24-8efe-9c3a1319cea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:23.131817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:23.132706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:23.134124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 226/439] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:23.135029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.135029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.135029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.159399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:23.160848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:23.169348 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.216295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8235e-d3e5-44fd-8362-56c94ec97f85 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.240751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 227/440] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:23.241346 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.270930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.271468 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.271745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.272065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.328736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.347854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.349401 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.351486 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53455-5f44-4cc8-a298-b992fef871df None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.386872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.387473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.387754 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.388026 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.388681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] RBAC: Adding query filter params (name=member) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:23.388981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.390335 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.403423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 228/441] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:23.404449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.409143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.468339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 214/442] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:23.475903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.536733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f50d7-54ac-4bca-9930-444a3064c57c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.572992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.573593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.573868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.574137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.578055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.594139 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34334f7-5e85-4220-8651-2504d1039d87 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.632123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.632752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.633033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.633305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.634526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.635969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.637549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 215/443] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:23.638306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.652512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.653944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.656576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.749339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316ef18-00c2-4790-bf7b-165eee5751f5 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.760699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 229/444] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 11:08:23.761526 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.787018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.788966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.789251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.789534 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.805834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:23.811297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:23.812466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 216/445] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:23.814157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.829710 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.877344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c953fe-88e8-4d8f-9dab-02b5c354caa9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.879990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:23.916485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.917231 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.917515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.917785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.919099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.920880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.922462 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 230/446] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:23.923722 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:23.931932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fb39-dc30-4bcd-b95a-2ee173fe732d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:23.967011 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:23.967661 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:23.967942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:23.968215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] PATH_INFO: `/v3/projects/50fc052af41346f5bf0f830b9ab81f5d` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:23.969333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] RBAC: Authorizing `identity:get_project(project_id=50fc052af41346f5bf0f830b9ab81f5d)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:23.970823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:23.972431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 217/447] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/projects/50fc052af41346f5bf0f830b9ab81f5d => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:23.973184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.028638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32aaf3-ef27-4466-9957-bd41ffdf80ef None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.062850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.064137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.064709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.065030 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.065637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.066567 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:24.066927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.068598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.077430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 231/448] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:24.078296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.089968 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734639b-f917-4868-a6e9-a1ef5f09838b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.117140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.129236 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.129915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.130254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.130597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.131532 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=6c1bfab1b76347f9a793a9ae11e773e1, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:24.131888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.133558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.140681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 218/449] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:23 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=6c1bfab1b76347f9a793a9ae11e773e1 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:24.143350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.204737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0ee3-ad7c-4054-b888-936fa8933a3d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.266962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.268004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.268499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.268946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] PATH_INFO: `/v3/groups/27013c5b00a349e0977d697ab9280760` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.270944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] RBAC: Authorizing `identity:get_group(group_id=27013c5b00a349e0977d697ab9280760)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.271349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52adf8-e761-4cca-b570-00398463fe32 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.274500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.276221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 232/450] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/groups/27013c5b00a349e0977d697ab9280760 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:24.282996 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.317216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.318017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.318521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.318977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.337914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.413116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaed85-4888-4e4f-9745-f98ea6a7e38b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.417227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.419065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.420521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.453848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.454511 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.454815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.455121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.455838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] RBAC: Adding query filter params (group.id=27013c5b00a349e0977d697ab9280760, role.id=a322b06c2e78439baafe5ece304846a2, scope.project.id=50fc052af41346f5bf0f830b9ab81f5d) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:24.456139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.457548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.463314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 233/451] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/role_assignments?group.id=27013c5b00a349e0977d697ab9280760&scope.project.id=50fc052af41346f5bf0f830b9ab81f5d&role.id=a322b06c2e78439baafe5ece304846a2 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:24.538084 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 219/452] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:24.544163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.653446 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1509c-bfbd-4369-abf1-5a013c86c846 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.689693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.690691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.691125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.691490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] PATH_INFO: `/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.693164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] RBAC: Authorizing `identity:get_project(project_id=aa345ead696a4e8d96d7636f92ce2f5c)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.694790 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.696742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 234/453] 10.222.0.25 () {56 vars in 1186 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/projects/aa345ead696a4e8d96d7636f92ce2f5c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:24.703109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.754621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.814050 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb4742-f4bb-4a44-91b5-dd9c82d9e899 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:24.850836 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:24.851542 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:24.851873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:24.852299 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] PATH_INFO: `/v3/groups/d2008423d67d453fbb18b72c3a7defc2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:24.853660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] RBAC: Authorizing `identity:get_group(group_id=d2008423d67d453fbb18b72c3a7defc2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:24.855902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d4c27-f2a4-47af-83bc-6b65aed4d3ed None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:24.858694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 220/454] 10.222.0.25 () {56 vars in 1180 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/groups/d2008423d67d453fbb18b72c3a7defc2 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:24.865174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:24.905929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:24.979526 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592b3dd-a129-4ac4-b71a-6a159bf31c97 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:25.020278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:25.020892 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:25.021168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:25.021434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:25.022158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] RBAC: Adding query filter params (group.id=d2008423d67d453fbb18b72c3a7defc2, role.id=812192d969e9436d9845f219dd311628, scope.project.id=aa345ead696a4e8d96d7636f92ce2f5c) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:25.022507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:25.023925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71507f8-76d8-4a96-a23f-9ce7cf1eb179 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:25.030020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 235/455] 10.222.0.25 () {56 vars in 1376 bytes} [Fri Sep 9 11:08:24 2022] GET /identity/v3/role_assignments?group.id=d2008423d67d453fbb18b72c3a7defc2&scope.project.id=aa345ead696a4e8d96d7636f92ce2f5c&role.id=812192d969e9436d9845f219dd311628 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:27.846544 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ee13-2219-4103-b42f-5933af054c8f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.847096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ee13-2219-4103-b42f-5933af054c8f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.847096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ee13-2219-4103-b42f-5933af054c8f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.848679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 221/456] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:27.854451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba304ab-8c60-46cd-8b99-177c7290fa1c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.855337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba304ab-8c60-46cd-8b99-177c7290fa1c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.855838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba304ab-8c60-46cd-8b99-177c7290fa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.875320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1ba304ab-8c60-46cd-8b99-177c7290fa1c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:27.877377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1ba304ab-8c60-46cd-8b99-177c7290fa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:27.938109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d945-2912-4df4-a12a-41bc835fa495 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.938753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d945-2912-4df4-a12a-41bc835fa495 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.939482 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95d945-2912-4df4-a12a-41bc835fa495 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.941263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 222/457] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:27.947018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d5bd-c89a-4cbe-b889-cf64f13612f3 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:27.947630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d5bd-c89a-4cbe-b889-cf64f13612f3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:27.948108 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869d5bd-c89a-4cbe-b889-cf64f13612f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:27.951603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 236/458] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:27.970873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-d869d5bd-c89a-4cbe-b889-cf64f13612f3 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:27.972095 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d869d5bd-c89a-4cbe-b889-cf64f13612f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:28.049841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 223/459] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:28.117994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20656fe-c99d-4bf3-ad6b-23a31be8ae4f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.118274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20656fe-c99d-4bf3-ad6b-23a31be8ae4f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.118499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20656fe-c99d-4bf3-ad6b-23a31be8ae4f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.119991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 237/460] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:28.125231 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.126074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.126385 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.145367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:28.146621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:28.184717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.226465 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 224/461] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:28.301370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20656fe-c99d-4bf3-ad6b-23a31be8ae4f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.331189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.381287 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.411670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20656fe-c99d-4bf3-ad6b-23a31be8ae4f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.453291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.454489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.454764 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.455034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.466026 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.467563 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-78c40db2-df03-47ec-97f0-fd34c5fa9e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:28.483935 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:28.485365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 238/462] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77524-87fa-4a55-8746-f281cd2df8d5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77524-87fa-4a55-8746-f281cd2df8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd77524-87fa-4a55-8746-f281cd2df8d5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.491647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 239/463] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:28.494241 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd77524-87fa-4a55-8746-f281cd2df8d5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.499720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8814f-9fea-486f-a38c-f6991a125033 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.541865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.542863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.543212 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.543481 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.554481 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.555990 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-341c121a-546c-4615-b555-49fc1c49913f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:28.572753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:28.573870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 225/464] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.579960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.586600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.595134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:28.596324 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:28.606921 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd77524-87fa-4a55-8746-f281cd2df8d5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.613731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.639851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.640321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.640593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.641387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.642017 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:28.642312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.643681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.655156 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 240/465] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:28.655937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.667910 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 226/466] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:28.668728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.759508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a11f9-fe27-408f-88e1-fb52793d5407 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.775599 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f076dc9-36e3-4213-89f1-42a0e07ad856 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.797178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.797815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.798087 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.798368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.807486 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.809585 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.811302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.820248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.820856 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.821612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.821883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.822862 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:28.823167 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.824540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:28.827305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:28.828395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:28.829236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:28.829236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:28.829236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:28.829236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 241/467] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:28.829236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.839804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 227/468] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:28.840918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:28.862261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:28.938066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada0253-100d-44ce-8055-fab73b9b1b4d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.958750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e9d8f-8a89-4484-af90-9fa626298a58 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:28.975180 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.975788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.976090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.976434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.977334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.978637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:28.993822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:28.994481 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:28.994844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:28.995027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:28.995657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:28.995957 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:28.997309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.004218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 242/469] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:08:28 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:29.005366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.010267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 228/470] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:29.010984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.065025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.100434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.126383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef899e-3120-4bcc-b223-d37bcac0eb9f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.129573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e596c-a3e3-4944-a979-b6c3555a1e2d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.167156 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.167775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.168049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.168327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.168960 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.169310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.170021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.170388 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.170502 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.170770 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.183747 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.185466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.206489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 243/471] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:08:29 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:29.206489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:29.214908 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:29.216041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:29.217172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:29.217172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:29.217172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:29.217172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 229/472] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:29.223163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.351902 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb020-1a52-4851-8696-c6fa87d174a8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.355004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.360318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdddc6b-2e29-4c1c-8268-11cf877a55ad None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.390044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:29.398970 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.399597 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.399875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.400146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.400806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.401345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.402068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.402275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf1331-98f8-48ff-992b-98f7c21817b4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.402562 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.402921 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.403798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:29.404197 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.405888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.422654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 230/473] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:29.428389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 244/474] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:08:29 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:29.429323 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:29.563413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f4583-b6fe-421e-ae31-b10e82e0b392 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:29.612374 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:29.613088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:29.613362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:29.613630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:29.614281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:29.615927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c930fe0-ae0a-4526-b6da-8d0aaf9c29ee None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:29.639993 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 231/475] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:08:29 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:08:31.726243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726127-8116-4d31-9177-9aa8343c9535 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:31.726759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726127-8116-4d31-9177-9aa8343c9535 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:31.726759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726127-8116-4d31-9177-9aa8343c9535 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:31.728330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 245/476] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:31.733894 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6d37-bc9d-40f3-b000-124eb928fc77 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:31.734870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6d37-bc9d-40f3-b000-124eb928fc77 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:31.735040 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6d37-bc9d-40f3-b000-124eb928fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:31.754496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-404b6d37-bc9d-40f3-b000-124eb928fc77 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:31.755711 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-404b6d37-bc9d-40f3-b000-124eb928fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:31.796467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:31.831511 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b8c78-b04e-4377-8137-a932af7ca454 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:31.831830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b8c78-b04e-4377-8137-a932af7ca454 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:31.832245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b8c78-b04e-4377-8137-a932af7ca454 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:31.833953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 246/477] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:31.835080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 232/478] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:31.839666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3808-e3ac-4673-922c-ae47f2e6846d None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:31.839950 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3808-e3ac-4673-922c-ae47f2e6846d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:31.840224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3808-e3ac-4673-922c-ae47f2e6846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:31.860409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-002b3808-e3ac-4673-922c-ae47f2e6846d None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:31.861690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-002b3808-e3ac-4673-922c-ae47f2e6846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:31.944142 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 247/479] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:31.994891 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b06-7cde-41c2-859d-d30f4b9ff6e0 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:31.995144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b06-7cde-41c2-859d-d30f4b9ff6e0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:31.995413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616b06-7cde-41c2-859d-d30f4b9ff6e0 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:31.996805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 233/480] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:32.003492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a640-246d-4412-bc19-ba3b34d843da None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.003779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a640-246d-4412-bc19-ba3b34d843da None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.004052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4a640-246d-4412-bc19-ba3b34d843da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.024974 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-76b4a640-246d-4412-bc19-ba3b34d843da None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:32.026513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-76b4a640-246d-4412-bc19-ba3b34d843da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:32.101861 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 248/481] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:32.203581 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616b06-7cde-41c2-859d-d30f4b9ff6e0 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.225032 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fcb0-e88e-4aea-88d7-3d55512b5ac6 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.225325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fcb0-e88e-4aea-88d7-3d55512b5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.225593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571fcb0-e88e-4aea-88d7-3d55512b5ac6 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.227212 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 249/482] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:32.232881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.233166 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.233441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.259006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:32.260112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:32.279330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.319518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616b06-7cde-41c2-859d-d30f4b9ff6e0 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.342679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 250/483] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:32.342679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.362220 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.363190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.363618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.364080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.376101 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:32.381381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:32.382484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.383340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:32.385623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 234/484] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:32.395575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.442020 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.449444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fee88-b276-4972-95fb-babe553eac9a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.486032 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.486958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.487420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.487690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.498413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:32.504134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:32.505007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 251/485] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:32.507497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.522798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd5390-0478-4ef1-bdb0-c420ce64dca2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.525606 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.563796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.564411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.564712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.564957 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.566317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:32.566317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:32.567872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:32.576251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 235/486] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:32.576251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.629443 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5759cf-e13a-45dc-8664-0c86153f1967 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.669739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.670403 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.670677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.670944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.677311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.682839 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:32.684641 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84603c49-f918-4d62-a57f-cb237d3a883e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:32.687601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:32.688915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 252/487] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:32.690065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.720340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.720938 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.721211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.721478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.722125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:32.722461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:32.723808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:32.731489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 236/488] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:32.732293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.765933 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.799204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5524-0ce7-4210-a72c-e3a8c28369d8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.833323 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.833948 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.834221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.834530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.834625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2620a-fc2f-4dee-b6ab-a6ef641d1463 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.844572 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:32.846318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:32.860915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:32.861927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:32.862822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:32.862822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:32.862822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:32.862822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 253/489] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:32.867206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.868766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:32.869388 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:32.869659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:32.869929 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:32.881459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:32.886727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:32.887623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:32.888432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 237/490] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:32.889080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:32.909793 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.967832 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef6cbb-6373-4436-927c-98b32c195572 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:32.990586 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:32.992138 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb983543-2957-4b43-b784-6bdee981ecf0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.005176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.005798 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.006079 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.006381 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.007090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.007396 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.008782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.018334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 254/491] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.019175 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.028350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.028975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.029248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.029519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.041080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.042579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:33.056998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.057918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:33.058813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:33.058813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.058813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:33.058813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 238/492] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.058813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.121506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd34f7-a6aa-4c2a-8d2e-2e253cbef421 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.128479 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.154840 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.155450 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.155730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.156005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.156642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.157231 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.158293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.162749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414a638-d40a-4e2f-9c9b-702c0ea08011 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.169923 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 255/493] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.170761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.198980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.199578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.199855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.200120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.200774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.201067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.202432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.210560 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 239/494] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.211373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.219668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.272992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e49a5-5265-4845-8037-6ca938062898 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.306444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.307115 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.307337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.307599 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.309381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba751d-3091-433f-adcd-4454bff882d9 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.317641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.319094 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:33.333088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.334013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:33.335138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:33.335138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.335138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:33.335138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 256/495] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.335138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.341512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.348207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.348896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.349180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.349455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.350098 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.350431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.351793 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.364449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 240/496] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.365259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.429989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.438168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363986d-c396-4187-8d9b-7ec77f89c564 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.467042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd88c-4142-4a43-9378-b6ccb9e8e67a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.472049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.472692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.472968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.473232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.480506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.481921 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:33.495387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.496457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 257/497] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.497359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.506305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.506966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.507242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.507509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.517494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.518972 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:33.534055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.535053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:33.535880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:33.535880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:33.535880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:33.535880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 241/498] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.536102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.588799 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.608085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c09c2-ba1b-4e26-8959-73b9c9c73134 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.641437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.642149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.642467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.642746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.643372 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.643662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.645040 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.645883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d9b7-31bf-4d48-a585-049fd2b48dd3 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.657537 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 258/499] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.658474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.676018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.681072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.681687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.681966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.682235 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.689574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.691063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:33.704297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.705250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 242/500] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.706137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.759704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0e50e-85ad-4ad5-9bc2-3003d3dbfed9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.792848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.793457 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.793696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.793961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.794708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.795006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.796421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.804983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dccd63-a730-4dbb-a2a7-500363fccce9 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.806524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.834429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 259/501] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.835176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.845006 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.845877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.845877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.846067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.847294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:33.847294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.848364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.860195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 243/502] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:33.860995 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:33.908881 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:33.933506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c8536-5de4-4e54-880c-754fb8863c3f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.962177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940fa07-afde-400f-8bba-63e92a6aeb34 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:33.967066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:33.967685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:33.967957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:33.968221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:33.975644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:33.977074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:33.988593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:33.989679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 260/503] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:33.990640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.000541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.001152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.001438 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.001691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.002444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:34.002746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.004195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.040323 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 244/504] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:34.041156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.062983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.091925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f08929-1455-448b-91e3-3a0ee1a9eb1b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.130288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.130820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.131102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.131379 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.134007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.141298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee0b30-9ddc-4c9f-a8eb-be513c73b762 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.176504 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.177122 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.177397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.177664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.184549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.185988 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:34.198707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:34.199593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:34.200464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 245/505] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:34.201021 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.201099 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.201706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.285267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.306369 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818cdeb-222d-4a90-8029-86ec6af23b92 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.306570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 261/506] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:34.307302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.340705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.344361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.344963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.345233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.345499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.346215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:34.346549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.347971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.370258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 246/507] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:34.370258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.414057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cc12b-2ffe-46bc-829a-a3c644539854 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.449529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.450258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.450569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.450836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.469715 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482acf7a-0754-4dba-91dc-4d735b5fdc46 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.504007 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.504610 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.504891 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.505161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.505882 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:34.506185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.507647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.516375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.517331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.519112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.526755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 247/508] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:34.527580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.556622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.623532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 262/509] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:34.624376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.627518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8f4c9-8bc9-432a-8849-24c3adcae6a7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.661139 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.661755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.662030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.662296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.672771 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.674130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:34.689364 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:34.690302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:34.691207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:34.691207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:34.691207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:34.691207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 248/510] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:34.691603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.722359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0515-8f43-4bc9-82de-f3692aa09c5c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.741111 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.756912 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.757507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.757779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.758042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.760583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.793280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12d164-0031-441d-afbd-041af07c7a12 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:34.827468 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:34.828242 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.828720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:34.828994 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:34.829264 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:34.829565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.898666 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:34.900236 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:34.936820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 263/511] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:34.938139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:34.947767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:34.979864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.003654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 249/512] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:35.004508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.037858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f173321-2dd2-4948-b8c4-382fdfa8947d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.071404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.072020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.072293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.072558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.082924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.084348 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:35.098395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.099458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:35.100745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:35.100745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.100745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:35.100745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 264/513] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.100745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.107129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dcf8e-ad18-4b6c-a602-acb17f45b83f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.141503 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.142103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.142408 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.142683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.143317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.143609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.144977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.156464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 250/514] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.157397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.171865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.185036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.200828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea0d91-9f54-4c93-b9c0-535dfb8ad446 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.233119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.233756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.235249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.235249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.246536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.248022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:35.267838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.268957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:35.270145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:35.270145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.270145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:35.270340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee225fc5-28c4-466d-8e83-912a6adb60b4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.270455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 265/515] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.270455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.305993 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.306642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.306918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.307188 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.318124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.319642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:35.334587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.335552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:35.336436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:35.336436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:35.336436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:35.336436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 251/516] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.336670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.371575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90210-3059-49e8-a417-60015537d7bc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.395067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.404529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.405127 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.405405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.405702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.406928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.407229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.408582 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.415429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.421664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 266/517] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.422496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.442265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851fb56-1135-45aa-8f70-e3785f877fb1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.476521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.477093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.477392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.477659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.484874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.486294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:35.497873 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.498961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 252/518] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.500417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.527055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df42ec-f563-4c70-8bd8-779e51933edf None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.562523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.563125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.563672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.563942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.564570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.564874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.566243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.577148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 267/519] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.578009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.600021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff6d9-54c5-408c-b3fa-38d15b5d4054 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.619509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.633953 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.634582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.634859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.635121 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.635532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.635750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.636051 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.637399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.649993 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 253/520] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.650824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.678308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8584f-fa76-446d-9a4d-c35504ae3596 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.710913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.711535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.711848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.712123 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.719322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.720730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:35.732190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.733035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:35.733941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 268/521] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.734584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.758090 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5a848-236d-4569-a5a7-387b5e61e21c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.792208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.792807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.793088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.793353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.794102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:35.794434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.795849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.814129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 254/522] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:35.815077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.840159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987d0a0-8d70-4bfa-bc92-898084078510 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.857645 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.857845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:35.875633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.876266 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.876539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.876802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.883512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.884950 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:35.897069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.898034 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:35.899121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 269/523] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.899821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:35.917373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760fb1-8008-4947-8fd9-1caac889162a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:35.952924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:35.953577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:35.953857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:35.954131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:35.961437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:35.962960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:35.974928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:35.975863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:35.976702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 255/524] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:35.977523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.003369 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e660f-cd5d-4f12-88b9-6629740e8650 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.036490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.037089 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.037369 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.037641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.038336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.038673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.040100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.058029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 270/525] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.058880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.074964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:36.078801 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc867d-0620-411e-9a2c-95617fe64a4d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.102610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:36.116318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.116931 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.117205 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.117469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.118205 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=a8460d3ea12e4126b928a51cd29587df) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.118617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.120088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.126469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 256/526] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:35 2022] GET /identity/v3/role_assignments?user.id=a8460d3ea12e4126b928a51cd29587df&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.127316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.191550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099542-dd2c-4d76-aa1b-19a4e0df7ab7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.244368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.245045 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.245281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.245553 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.246327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.246613 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.248112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.258275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1e028-4578-4b8c-95a0-12c26b8b1658 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.262499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 271/527] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.263271 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.304421 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.305081 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.305360 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.305632 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.306365 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.306746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.308264 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.322765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 257/528] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.323709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.353782 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:36.401419 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:36.407402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c1f3e-6fc8-4936-8069-c586cdfa876d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.454801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.455408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.455686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.456118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.457203 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=17bcafde41734dbe8c9a400aa9bbf802) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.457665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.459128 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.464594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244007-aeaa-45da-9621-8a8bc90f769e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.472544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 272/529] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:36 2022] GET /identity/v3/role_assignments?user.id=17bcafde41734dbe8c9a400aa9bbf802&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.473278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:36.512681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.513219 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.513495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.513773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.514556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=397af280379f4d7c87ffad8b19d76100) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.515533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.516442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490320-2d8f-4ef3-8a9f-83c2e5937844 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.524509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 258/530] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:36 2022] GET /identity/v3/role_assignments?user.id=397af280379f4d7c87ffad8b19d76100&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:36.646325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515823-602a-42aa-9a50-5b4f5aab8ece None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:36.699679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:36.701121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:36.701864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:36.702954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:36.704017 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=35c6844418444e628e65ff78e25f5d41) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:36.704504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:36.706251 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb758-1439-47f5-8d8c-31624c3bc83f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:36.718875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 273/531] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:36 2022] GET /identity/v3/role_assignments?user.id=35c6844418444e628e65ff78e25f5d41&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:38.570073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9d20-a178-4ae5-bf4f-104acb9351e3 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:38.570656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9d20-a178-4ae5-bf4f-104acb9351e3 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:38.570656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff9d20-a178-4ae5-bf4f-104acb9351e3 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:38.572336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 259/532] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:38.577537 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38440-c196-445c-80cf-119b90fdee24 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:38.578428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38440-c196-445c-80cf-119b90fdee24 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:38.578911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38440-c196-445c-80cf-119b90fdee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:38.599043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-77a38440-c196-445c-80cf-119b90fdee24 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:38.600628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-77a38440-c196-445c-80cf-119b90fdee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:38.627664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:38.689829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 274/533] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:39.015385 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff9d20-a178-4ae5-bf4f-104acb9351e3 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.082843 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961a27-9a8f-46cf-8c44-4dc06a89694b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.083120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961a27-9a8f-46cf-8c44-4dc06a89694b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.083429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf961a27-9a8f-46cf-8c44-4dc06a89694b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.084943 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 275/534] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:39.091440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c266-f008-433c-b74c-b0bb3b9e18e2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.091800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c266-f008-433c-b74c-b0bb3b9e18e2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.091954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c266-f008-433c-b74c-b0bb3b9e18e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.112075 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c045c266-f008-433c-b74c-b0bb3b9e18e2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:39.113245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c045c266-f008-433c-b74c-b0bb3b9e18e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:39.163298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.178815 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff9d20-a178-4ae5-bf4f-104acb9351e3 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.210565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 276/535] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:39.210565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10667-f7b2-4aa5-b1ad-7132285ae4d6 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.210851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10667-f7b2-4aa5-b1ad-7132285ae4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.211244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10667-f7b2-4aa5-b1ad-7132285ae4d6 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.213531 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 277/536] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:39.220156 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba74e4-748a-4e07-836e-1415e4cf0490 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.220523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba74e4-748a-4e07-836e-1415e4cf0490 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.220867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba74e4-748a-4e07-836e-1415e4cf0490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.225533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.226462 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.226888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.227305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.240088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:39.241424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b8ba74e4-748a-4e07-836e-1415e4cf0490 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:39.242785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b8ba74e4-748a-4e07-836e-1415e4cf0490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:39.245649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.246798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.247640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:39.251217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 260/537] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:39.263549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.335025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 278/538] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:39.337602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906ec46-687d-461d-ba8e-830b776c0dbd None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.338331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906ec46-687d-461d-ba8e-830b776c0dbd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.339055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906ec46-687d-461d-ba8e-830b776c0dbd None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.341636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 279/539] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:39.347395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.347658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.347985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.370145 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:39.371653 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:39.384243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.399699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e532f-9cf4-471f-b5df-190f91a484f1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.445068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.445828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.446161 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.446485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.447241 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:39.447556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.449009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.463337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 280/540] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:39.466497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 261/541] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:39.467576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.568559 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.586541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.587456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aed39-8e6d-4cca-9a12-3908a86c6188 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.629113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.629751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.630026 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.630292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.642001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.644125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.653547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:39.664513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.665591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:39.667139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:39.667139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:39.667139 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:39.670602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 281/542] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:39.672131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.724826 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45c80-c9c6-4af9-8d71-437ab21b4c14 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.765436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.766211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.766525 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.766800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.779997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:39.785258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.786184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 262/543] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:39.787154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.797577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8cf8b-0ed5-403f-a599-145e6bc29987 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.849952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.850858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.851331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.851727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.852730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:39.853195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:39.855505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:39.861914 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.876429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 282/544] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:39.877766 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:39.897279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b459399-c1fa-4338-aae8-3b754f43a926 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:39.932626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:39.933251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:39.933528 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:39.933795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:39.945391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:39.945964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:39.951404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:39.953345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 263/545] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:39.954381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.004738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402904-f2fb-4f84-bc6b-0d4036f273cc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.040972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.041577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.041851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.042117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.042821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.043119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.044492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.053389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 283/546] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.054230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.071333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b28558-e5cf-4010-947c-5d95b79de18c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.101040 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.107752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.108892 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.109177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.109446 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.120748 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:40.125869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.126950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:40.127808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 264/547] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.128804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.157129 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029516-204b-4d6d-936f-55341ee71817 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.178109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.192752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.193475 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.193756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.194022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.201772 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.203293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:40.215019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.216014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 284/548] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.216929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.238435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393d659-da53-44f6-b670-db25dc5c0960 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.273911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.274541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.274817 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.275082 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.276122 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.276428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.277807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.286725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 265/549] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.287556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.324584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f23506-c40a-499c-b012-cc9def494ea4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.341996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.360661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.361436 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.361984 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.362478 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.375828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.377278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:40.392347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.393305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:40.395041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:40.395041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.395041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:40.395041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 285/550] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.395041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.395334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4038f-8bfd-40cd-9cee-a258cf5aa299 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.429056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.429565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.430633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.430913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.431260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.432056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.432366 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.433768 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.442676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 266/551] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.443347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.508590 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb344830-05d3-4515-bad6-b2d442d52d41 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.543588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff0a3-9247-49c8-bb7f-50df64e81d9b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.545114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.545937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.546262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.546691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.547872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.548363 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.550845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.561261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.570734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 286/552] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.571584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.586755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.587415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.587671 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.587946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.600705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.602182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:40.617141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.618296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:40.619761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:40.619761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.619761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:40.619761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 267/553] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.619761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.670182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.681036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11260646-479b-4b26-960f-825e49e6b02d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.715656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.716264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.716551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.716823 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.717458 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.718332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.719722 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.726482 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70346c1-cf99-48a2-bd50-4ba7f401a1c0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.731113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 287/554] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.731981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.763694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.764332 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.765193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.765473 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.776568 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.778030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:40.792672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.793670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:40.799867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:40.799867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.799867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:40.799867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 268/555] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.799867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.815576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.836168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab79c-aca4-4f13-b8f9-2eeb8f1a4041 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.871796 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.872363 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.872624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.872893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.884338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.885789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:40.902782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:40.903926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:40.908666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:40.908666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:40.908666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:40.908666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 288/556] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:40.908666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:40.909291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5464e-8fb7-495e-8345-a2f6600b5699 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:40.911644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:40.950075 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:40.950982 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:40.951258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:40.951526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:40.952759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:40.953057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:40.954459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:40.966326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 269/557] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:40.967207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.017580 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753357fb-ba85-4917-bb40-caeb7fdb988c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.050279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.058106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.059192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.059670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.060134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.071055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.072628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.081282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be261-f095-43d3-a823-49f2941d4870 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:41.084756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.086201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 289/558] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.087375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.126414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.126946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.127223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.127495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.128135 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.128437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.129813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.141806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 270/559] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.142721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.163184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.204439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c29e6-b307-4ac0-83f9-0f6788883352 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.239179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.239786 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.240064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.240339 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.240977 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.241281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.242685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.246491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a353f4-157a-4a58-9063-150337b40c9e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.255853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 290/560] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.256705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.286668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.287298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.287582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.287857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.295582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.297558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.299490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:41.310676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.312466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:41.313676 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 271/561] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.314253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.366004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b546ed-05de-4924-867c-5baadf02d92e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.389447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.401093 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.401733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.402018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.402291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.403049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.403352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.404792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.418179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9a3fa-8964-4521-b245-03a0776ff4be None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.422742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 291/562] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.423622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.455950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.456577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.456850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.457118 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.464719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.466140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:41.477811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.478915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 272/563] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.480208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.532295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d302d6-ecfe-4f62-abb6-bc3d8649ff3a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.549666 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.568106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.568735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.569014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.569292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.576023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.577938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:41.589394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.590495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 292/564] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.591384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.594653 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683ea5-f247-4c8c-922b-f31ace843d83 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.628885 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.629488 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.629763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.630029 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.630781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.631080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.632522 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.634250 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.650571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 273/565] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.651328 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.703460 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf224c2-0cf8-4ae7-add2-a5ed1e987e4b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.740132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.740763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.741042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.741314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.752116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.753605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.758818 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d873d-cb8f-457f-a3c0-6026681e7755 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:41.767735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.768738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:41.769631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:41.769631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.769631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:41.769631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 293/566] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.769631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.780530 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.799601 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.800209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.800490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.800759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.801493 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.801791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.803300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.822590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 274/567] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.823702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.865347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:41.876373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f4cd9-3a96-46e6-a80d-019183e480b3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.910629 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.911160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.911523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.911704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.912391 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:41.912697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.914131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.924303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2b729-7035-4ffb-93e1-c53e733d8b6f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:41.926169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 294/568] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:41.927015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:41.965483 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:41.966571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:41.966852 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:41.967120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:41.979824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:41.981417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:41.997250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:41.998618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:41.999949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:41.999949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:41.999949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:41.999949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 275/569] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:41.999949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.029097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cefad6-01f5-4609-bdd9-1bdb26624ecd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.029502 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.063775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.064368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.064641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.064917 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.065538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:42.065835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.067220 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.078978 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 295/570] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:42.079782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.097719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.104543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf2068-2b8b-431d-bca4-2961047b703a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.137282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.137911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.138189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.138501 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.149716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.151169 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:42.165628 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:42.166673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:42.167586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:42.167586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:42.167586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:42.167586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 276/571] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:42.167586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.188243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dde7bd-71a2-43b4-a9af-70671a39ce86 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.221739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.222577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.222860 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.223132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/a8460d3ea12e4126b928a51cd29587df/roles/0caae7c117834b60970ae37fdc1f3874` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.237836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=a8460d3ea12e4126b928a51cd29587df, role_id=0caae7c117834b60970ae37fdc1f3874)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.239306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.246631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.252650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 296/572] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:42 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/a8460d3ea12e4126b928a51cd29587df/roles/0caae7c117834b60970ae37fdc1f3874 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:42.253636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.271310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9dc44-8060-4071-9db1-9e6d4212f9f4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.313404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.314023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.314964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.315248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.315917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:42.316217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.318495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.337257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 277/573] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:42.337257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.345375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.395589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f31e33-1d13-4f36-a250-d2ab033565b9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.448954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc4e37-9402-4af0-8b57-5faf95293210 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.452657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.453414 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.453752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.454089 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.462196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.463712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:42.483027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:42.484527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 297/574] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:42.485846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.499779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.500755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.501036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.501623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.502587 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:42.502893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.504443 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.513397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.519536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 278/575] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:42.524734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.599953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590232d-6281-45f7-bc06-a24bc45511fe None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.625373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.636100 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d0e4-f148-41c1-8107-9a006bf355f6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.640141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.640781 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.641064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.641334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.649393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.651515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:42.663993 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:42.665120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.666237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:42.669828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 298/576] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:42.671256 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.677440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.678050 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.678329 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.678636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.679361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:42.679663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.681283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.698484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 279/577] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:42.698841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.790902 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d777ff-25a9-4e8c-ac18-0accc0340479 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.807431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.828120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.828757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.829031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.829296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.836209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.837670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:42.849234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:42.850141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 299/578] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:42.851090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.869261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813b17-8402-444b-9c4b-3a1a5fcd6618 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:42.906682 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:42.912920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:42.913529 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:42.913805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:42.914073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:42.914791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:42.915092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:42.916518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:42.929107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 280/579] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:42.929807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:42.978230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844433-72ba-4370-b143-55836a157a64 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:43.012707 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:43.013366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:43.013640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:43.013913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/17bcafde41734dbe8c9a400aa9bbf802/roles/0caae7c117834b60970ae37fdc1f3874` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:43.029571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=17bcafde41734dbe8c9a400aa9bbf802, role_id=0caae7c117834b60970ae37fdc1f3874)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:43.031593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:43.044441 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce558c-0365-4ed3-a18a-91b48044ea08 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:43.046577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 300/580] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:42 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/17bcafde41734dbe8c9a400aa9bbf802/roles/0caae7c117834b60970ae37fdc1f3874 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:43.047027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:43.067971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:43.090896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:43.091570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:43.091855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:43.092127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:43.093470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:43.093780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:43.095718 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:43.115097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 281/581] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:43.116929 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:43.183447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:43.196432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6bcdf-f261-4d3b-be6e-830077ea070c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:43.237983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38036-198d-4145-80a2-1b26078f87f0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:43.240763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:43.241733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:43.242218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:43.242730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/397af280379f4d7c87ffad8b19d76100/roles/0caae7c117834b60970ae37fdc1f3874` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:43.261989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=397af280379f4d7c87ffad8b19d76100, role_id=0caae7c117834b60970ae37fdc1f3874)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:43.264677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8007-3428-46b4-b667-03b29209ee25 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:43.285922 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 301/582] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:43 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/397af280379f4d7c87ffad8b19d76100/roles/0caae7c117834b60970ae37fdc1f3874 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:08:43.290439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:43.291221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:43.291764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:43.292247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/35c6844418444e628e65ff78e25f5d41/roles/0caae7c117834b60970ae37fdc1f3874` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:43.316594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=35c6844418444e628e65ff78e25f5d41, role_id=0caae7c117834b60970ae37fdc1f3874)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:43.318074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea532f1-5cec-4347-bd44-7b291ea328d2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:43.350411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 282/583] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:08:43 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/35c6844418444e628e65ff78e25f5d41/roles/0caae7c117834b60970ae37fdc1f3874 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:08:44.845342 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccee-025e-4ac0-ab1b-e28b557072fc None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:44.845863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccee-025e-4ac0-ab1b-e28b557072fc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:44.845863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccee-025e-4ac0-ab1b-e28b557072fc None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:44.847426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 302/584] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:44.852869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:44.853700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:44.854167 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:44.873223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:44.874582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:44.899485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:44.946976 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 283/585] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:45.269512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00ccee-025e-4ac0-ab1b-e28b557072fc None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.381465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00ccee-025e-4ac0-ab1b-e28b557072fc None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.417685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.418322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.418620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.418888 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.430172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:45.435162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:45.436630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:45.438110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 303/586] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:45.450943 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.572558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa398c-8077-4a5c-b1b1-02945159d183 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.609898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.610538 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.610819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.611081 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.611740 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:45.612041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.613418 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e420c-a187-4db4-99ec-7906a966a8cb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:45.622417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 284/587] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:45.628184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.633677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.678965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf2fc-e25d-4f4d-86d7-97f8e54cf7fb None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.679596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf2fc-e25d-4f4d-86d7-97f8e54cf7fb None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.680147 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bf2fc-e25d-4f4d-86d7-97f8e54cf7fb None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.681891 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 285/588] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:45.688191 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.688626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.688991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.709521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:45.710889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:45.727029 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:45.747564 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5963f-87a2-4afc-a03e-69579b04eb45 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.792998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 286/589] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:45.793219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:45.793219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.793219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.793219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.804035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:45.805880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4a8f49a3-13b3-45fb-8491-5297f2bff9cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:45.821690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:45.822915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:45.823848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:45.823848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:45.823848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:45.828132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 304/590] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:45.829576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:45.931306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8cead-2005-4443-b7d5-74826b7d2692 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.931900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8cead-2005-4443-b7d5-74826b7d2692 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.931900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8cead-2005-4443-b7d5-74826b7d2692 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.934795 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 305/591] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:45.939863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e4d8-553e-420b-a868-7e5f6ff2dbd0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:45.940196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e4d8-553e-420b-a868-7e5f6ff2dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:45.940463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49e4d8-553e-420b-a868-7e5f6ff2dbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:45.955670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0bb9-ae1c-412d-bd51-160b7cc20515 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:45.961194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ba49e4d8-553e-420b-a868-7e5f6ff2dbd0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:45.962496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ba49e4d8-553e-420b-a868-7e5f6ff2dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:46.002378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.003338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.003625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.003901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.004807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:46.005117 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.006741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d8e3b-c264-405a-b705-3f1325119cf4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.021472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 287/592] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:46.023721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cdf2-68d9-4612-b04b-985fe0477e0f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.024060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cdf2-68d9-4612-b04b-985fe0477e0f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.024339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8cdf2-68d9-4612-b04b-985fe0477e0f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.025736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 288/593] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:46.027049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cdf2-68d9-4612-b04b-985fe0477e0f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.033303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.041683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.054449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 306/594] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:46.055749 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.056036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.056306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.087140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:46.088665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:46.160906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8cdf2-68d9-4612-b04b-985fe0477e0f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.171381 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 307/595] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:46.172132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.206265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.207406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.207967 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.208530 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.217260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.219203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:46.232739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.233762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:46.234738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:46.237384 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 289/596] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.246400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.286278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bdde8-2244-4812-a2c2-7a6cf3de87e0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.302563 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.327512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.328147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.328419 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.328687 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.339996 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:46.345291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.346327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.347192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:46.350751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 308/597] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.352623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.359418 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.400204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1fdc5-4972-4a32-abcd-fabeb39de745 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.440414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.441033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.441316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.441654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.444855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:46.444855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.444855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.465597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 290/598] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:46.470874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.478875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d03026-a16e-470f-a864-40d394c9f271 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.515044 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.515668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.515924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.516190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.516837 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:46.517131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.518523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.526549 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 309/599] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:46.527349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.562641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.576806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e42e1-1777-4e10-9aef-4e2cc2b75b54 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.603524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.612805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362364-9947-474d-a318-555c95971b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.613431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362364-9947-474d-a318-555c95971b0d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.613705 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362364-9947-474d-a318-555c95971b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.613974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362364-9947-474d-a318-555c95971b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.624800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362364-9947-474d-a318-555c95971b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:46.629257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed16b2-38ff-4941-b274-a303c157fcbc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-59362364-9947-474d-a318-555c95971b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:46.629487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.630512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:46.631353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 291/600] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.632043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362364-9947-474d-a318-555c95971b0d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.667963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.668564 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.668839 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.669106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.730917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362364-9947-474d-a318-555c95971b0d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.739256 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.740941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.769027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.769646 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.769923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.770198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.775043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.781594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:46.786318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.787621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 292/601] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.789216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.842659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:46.853006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 310/602] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:46.853908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.896936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9a99-fb74-4b18-8750-638ecf1ac0b2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.932060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.932751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.933034 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.933305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.944840 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.946323 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.955721 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1df2-dd53-457c-84c4-92362f9bff5f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:46.961515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:46.962753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:46.963616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:46.963616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:46.963616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:46.963616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 293/603] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:46.963843 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:46.993301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:46.993903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:46.994182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:46.994480 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:46.995138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:46.995433 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:46.996777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:46.999009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.006023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 311/604] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.006914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.067241 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.070159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249cb98-769d-45f3-87d3-2e1c51f34654 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.106148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.106699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.106979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.107252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.107579 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb751f-32d0-4b36-ae3f-778c19ff1dde None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.107994 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.108297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.109669 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.118105 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 294/605] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.119073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.144900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.145544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.145848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.146099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.158320 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.159850 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:47.175213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.176294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:47.177167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:47.177167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.177167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:47.177167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 312/606] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.177966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.230921 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.235959 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e183ab8-dc5e-41c0-acf9-f6fc0ff0fe72 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.273954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.274589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.274865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.275132 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.275766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.276064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.277413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.288680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7278cb9-24b2-49bc-a8ce-f19ab9b982b2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.290794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 295/607] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.291651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.316497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.333364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.334012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.334286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.334622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.348162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.349684 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:47.366389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.367532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:47.368623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:47.368623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.368623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:47.368623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 313/608] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.368882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.412201 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989654-36da-4180-a50c-a8d5375075f7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.452828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.453453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.453725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.453999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.464525 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.466005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:47.481767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.482844 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:47.486593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:47.486593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:47.486593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:47.486593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 296/609] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.486593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.497439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461152c1-c339-4705-a37e-0be0a2694dd7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.500038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.541030 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.541689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.542050 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.542413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.543194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.543566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.545061 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.557107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 314/610] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.557947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.573298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.598008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef523-ce1e-49a3-b30f-4ab1973d49e4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.631314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.631853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.632129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.632397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] PATH_INFO: `/v3/users/glance` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.640447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.641877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:47.652979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.653975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 297/611] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.655033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.665532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429b0d-8245-4f11-8e84-057dd5407192 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.699183 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.699784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.700058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.700322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.700949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.701857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.703245 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.714724 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 315/612] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.715624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.740037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.766434 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc631c-f1d5-44ab-b276-814d05859ceb None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.799370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.799969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.800245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.800511 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.801138 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.801431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.802821 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.804252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.815956 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 298/613] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.816785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.818155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08ebc8-cd21-4ae3-ba0f-377804cf1d3b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.851785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.852399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.852675 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.852940 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.859917 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.861360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:47.872816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:47.874914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 316/614] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:47.875825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.921110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645c01a-cf22-4fe2-9136-b5357469b6ea None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:47.956495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:47.957093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:47.957368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:47.957635 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:47.958377 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:47.958683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:47.960080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:47.964664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:47.977251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 299/615] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:47.978068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:47.981415 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506da7-243f-40a8-a23c-8131b7947e95 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.021523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.022158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.022473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.022754 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.030687 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.032157 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.038583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:48.044221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:48.045812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 317/616] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:48.047107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.098925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606598f1-e254-4584-a2fd-5b9855457610 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.133595 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.134224 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.134537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.134809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.142083 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.143550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.150306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42196566-b6b3-4164-adab-821cf0ee4d42 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:48.155097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:48.156113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 300/617] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:08:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:48.157064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.189177 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.189686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.189969 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.190241 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.190975 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:48.191280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.192716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.205012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 318/618] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:48.205852 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.208475 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.261582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e92a-c16f-49b1-abcb-b67c7b5c2109 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.274391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.297396 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.298075 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.298372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.298648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.306885 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c06cd-f1eb-4012-be23-c70f626fab8b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.341203 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.342329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.342635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.342908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.343630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:48.343932 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.345362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.362534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 319/619] 10.222.0.25 () {56 vars in 1137 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:48.363349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.365752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.367234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.422209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.466305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95830ec-22dc-45eb-ad0b-eb963ecd7175 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.474216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 301/620] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:48.474216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.485430 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.501493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.502102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.502408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.502686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.503408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:48.503714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.505169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.527753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 320/621] 10.222.0.25 () {56 vars in 1139 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:48.528617 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.601293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad71ba-513b-4369-8eca-536592b998ae None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.666703 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.667753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.668279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.668731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.670652 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=a8460d3ea12e4126b928a51cd29587df) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:48.671206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.673950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.698397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 302/622] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/role_assignments?user.id=a8460d3ea12e4126b928a51cd29587df&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:48.698397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:48.741101 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edea0c-3301-41e0-b584-d8c3391372a7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.794951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.830232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.831265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.831697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.832113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.841057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:48.890390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadbacb-cdeb-4d1d-9dad-a366ffff246b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:48.958880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:48.960278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:48.960961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:48.961654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:48.966441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.969097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:48.979756 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:48.981223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:49.004905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:49.006745 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:49.011571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:49.011571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.011571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:49.011571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 303/623] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:49.011571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.112575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 321/624] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:49.114039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.141411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.200010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83745162-c11c-4c02-8eea-d92227eccfda None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.234390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.245045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:49.245662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:49.245972 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:49.246232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:49.291742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1863-4439-4982-99e1-d4fd52a17719 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.336741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:49.339692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.353959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:49.354946 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:49.355296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:49.355634 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:49.356517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:49.356962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:49.359348 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.386409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 322/625] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:49.386409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.518406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 304/626] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:49.518406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.525097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.556466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439a90e-fce7-492d-8b37-1482593f7fe4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.568509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.604329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:49.605639 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:49.606130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:49.606629 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:49.623389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:49.626025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:49.645470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:49.646706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:49.647592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:49.647592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.647592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:49.653113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 323/627] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:49.653113 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.698024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e87104-6167-4aa1-8660-88f5bf891600 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.744755 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:49.745476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:49.745753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:49.746026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:49.756632 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:49.758888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:49.774134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:49.783187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 305/628] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:49.784855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:49.854584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d6ef-8a96-4bf9-a8b4-0a2b82bcd20d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.910097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.922874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:49.924009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:49.924462 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:49.924949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:49.948047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:49.952056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:49.952794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:49.971968 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3a3-1da7-449a-9408-bf65cdefe8ac None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:49.980801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:49.983767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:49.985760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:49.985760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:49.985760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:49.985760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 324/629] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:49.985760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.027739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.028576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.028719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.028894 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.030963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.031261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.032945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.053164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 306/630] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:50.054151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.164204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3af1-77c0-4feb-955b-1f10067f1bd9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.217794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b284d3-9e13-4139-a2b1-201cff5535ef None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.226818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.227831 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.228311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.228768 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.230004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.230560 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.233533 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.257192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 325/631] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:50.258733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.288288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.289822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.290597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.291355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.292737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.293600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.297100 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.318822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 307/632] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:50.320798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.341924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.346643 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.446161 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9009fee-e062-43d1-a248-031fed1b16f9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.492858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.493639 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.493997 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.494324 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.502315 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.503926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:50.516410 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:50.518146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:50.520218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:50.522388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 326/633] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:50.523354 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.529551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7fe78-c75b-4381-bb92-b7ce91e55758 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.595965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.596900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.597359 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.597820 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.599189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=17bcafde41734dbe8c9a400aa9bbf802) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.599722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.602390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.612904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 308/634] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/role_assignments?user.id=17bcafde41734dbe8c9a400aa9bbf802&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:50.614330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.702218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353497c1-f5db-4771-a012-e782fe3a2c63 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.706890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.775541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:50.788941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.790666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.791450 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.792206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.809343 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.812681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:50.836035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:50.837716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:50.839877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 327/635] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:50.847505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:50.869868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d0b4b-e184-4cd4-bc12-374c1db5e1f2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:50.947435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:50.948846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:50.949545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:50.950216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:50.952025 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:50.952624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:50.956266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:50.977573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 309/636] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:50.983715 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.010926 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502cb60-57b9-4dbb-969c-b4b22ac5a8c7 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.083237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.084547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.085307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.085925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.087240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.088020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.090667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.113158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 328/637] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:51.124013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:51.163668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116352c-810c-461e-96a8-884f1909d4e8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.178826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.224960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:51.236735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.237970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.238642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.239630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.240874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=397af280379f4d7c87ffad8b19d76100) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.241581 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.244611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be71b7-a9b2-4b34-adf8-2f353f90a459 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.257450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 310/638] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:50 2022] GET /identity/v3/role_assignments?user.id=397af280379f4d7c87ffad8b19d76100&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:51.351191 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b5bc8-473d-41b9-80f5-a22f8bfeb8cf None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:51.424473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:51.425905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.426550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.427138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.428703 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=35c6844418444e628e65ff78e25f5d41) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:51.429373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:51.432360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398d6c6-665a-45a9-a2cb-29cc7ba61416 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:51.454570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 329/639] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:51 2022] GET /identity/v3/role_assignments?user.id=35c6844418444e628e65ff78e25f5d41&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:51.839872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a04109-490b-4d95-84d3-1574154fc22e None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.840145 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a04109-490b-4d95-84d3-1574154fc22e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.840425 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a04109-490b-4d95-84d3-1574154fc22e None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.842766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 311/640] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:51.848600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:51.848938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:51.849185 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:51.876404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:51.878529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:52.009501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 330/641] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:52.336973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a04109-490b-4d95-84d3-1574154fc22e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:52.463509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a04109-490b-4d95-84d3-1574154fc22e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:52.530183 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:52.531764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:52.532535 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:52.533296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:52.555141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:52.566338 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:52.568376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:52.570193 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:52.575477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 312/642] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:52.582545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:52.602184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:52.744090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb536-f25e-4586-ab42-a3eea823f3ef None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:52.817610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:52.819011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:52.819632 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:52.820293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:52.821656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:52.822330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:52.825121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:52.843705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 331/643] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:52.851521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:52.948917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:53.028274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b96e1-103f-4155-9a12-9738613e1ef5 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:53.089061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:53.090101 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.090602 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.091691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:53.113393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:53.116334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:53.145797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:53.147670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:53.149250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:53.149250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:53.149250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:53.149250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 313/644] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:53.159616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:53.312275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:53.355725 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb066b02-82f2-4337-bfd8-40f12c4b5cd8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:53.410408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:53.411043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.411358 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.411603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:53.412240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:53.412538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:53.413931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd6c37-c6ae-48ae-8e42-694dc6baf877 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:53.430038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 332/645] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:53.460429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:53.689360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1580-b892-499a-ab93-6a44f5c466e5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.690155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1580-b892-499a-ab93-6a44f5c466e5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.690155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1580-b892-499a-ab93-6a44f5c466e5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:53.692774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 333/646] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:53.694039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be385-0cc1-4f20-b2a0-e494b4eda2cf None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:53.699735 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.700014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.700282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:53.711690 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:53.725085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:53.726804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:53.742339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:53.743260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.743620 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.743897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:53.753412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:53.754912 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:08:53.769190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:53.770210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:53.771203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 314/647] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:08:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:53.777517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:53.826483 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 334/648] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:53.930853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3bb78-237d-4dfc-b36d-ee018c0868ab None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:53.995688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:53.997117 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:53.997943 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:53.998723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.000327 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:54.001205 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.004179 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.035486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 315/649] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:08:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:54.044652 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.125901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.168352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7998a9-6bb9-49d5-aec2-577ce4430a81 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:54.187062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.210297 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:54.211013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.211347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.211736 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.223852 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.318037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.321898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.334142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb126b3-a8ca-4055-9bd7-4b73ab1a03b2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:54.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:54.381235 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.381636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.381903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] PATH_INFO: `/v3/services/image` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.382518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.384158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:54.397600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:54.399545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:54.401720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 316/650] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:54.407332 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.451896 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.493500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 335/651] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 11:08:54.503944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.530831 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.547842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec543da-458c-4f19-9c50-0369bb536a13 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:54.612875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:54.616789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.616789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.616789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.616789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] RBAC: Adding query filter params (name=image) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:54.616789 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.618682 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.626955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 317/652] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:54.635482 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.668012 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0d6e4-a3fb-48ad-9490-8a0fc35de314 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:54.722080 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:54.723451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.724360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.724788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.741336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.743665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.750655 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4af7f-dea1-4df2-b00e-1767aa831a2b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:08:54.766023 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:54.767281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:08:54.768376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:08:54.768376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:08:54.768376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:08:54.769701 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 336/653] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:54.778124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:54.796030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:54.797578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.798106 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.798649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.799936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] RBAC: Adding query filter params (type=image) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:54.800456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:54.802461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b525e-2cf7-4155-abfb-933b8fd97870 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:54.812289 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 318/654] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:54.822385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.847141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524d02-0f17-478b-8db3-d57b1db1e70f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.847827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524d02-0f17-478b-8db3-d57b1db1e70f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.848311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524d02-0f17-478b-8db3-d57b1db1e70f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.850248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 319/655] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:54.857072 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:54.857732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:54.858218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:54.879391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:54.881076 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:54.902032 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:54.969160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 320/656] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:54.990249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1255a6-cb65-417b-8f44-dbe0c2259da5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.063598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.064773 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.065263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.065744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.066958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:55.067494 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.070282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3589-069c-49ca-ba14-0f0da1cc7475 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.095264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 337/657] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:55.103009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.118551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250da5c-ab57-4ead-9efe-b85523bda4c5 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.119008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250da5c-ab57-4ead-9efe-b85523bda4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.119469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250da5c-ab57-4ead-9efe-b85523bda4c5 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.123128 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 338/658] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:08:55.132069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.132398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.133246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.162836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:55.164920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:55.227845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b781e-f50d-454a-9615-3d0d0461aef8 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.276475 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.277590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.278133 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.278449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 339/659] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 11:08:55.279278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.289378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.291248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:08:55.306048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:55.307053 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:08:55.308213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:55.312729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 321/660] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:55.320081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.362768 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:55.440630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ca3c8-f6cf-4f98-bb71-e56644f31c81 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.482702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.483475 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.483832 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.484200 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.485108 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:55.485514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.487640 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.505750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 340/661] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:55.511429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.522102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.526784 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:55.663319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:55.701230 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b360-39a5-4d1f-85a2-6e0aaf8bbbba None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.720737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019793d9-68f4-4b59-9533-3c6ff572440e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:55.763804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.764966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.765400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.765834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.766698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.768767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.780991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:55.781923 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:55.782385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:55.782824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:55.784128 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=a8460d3ea12e4126b928a51cd29587df) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:55.784788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:55.785281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:55.786242 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:08:55.791444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:55.792717 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:55.792794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 322/662] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:08:55.792794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:55.797332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 341/663] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/role_assignments?user.id=a8460d3ea12e4126b928a51cd29587df&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=812192d969e9436d9845f219dd311628 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:55.798815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.019197 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.041906 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9da86-5649-4c3a-93f3-7d0280bf7398 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.047689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393c3a1-bbc3-4532-b810-b8c55ba4c716 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.093182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.094233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.094872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.095342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] PATH_INFO: `/v3/services/network` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.096247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.097928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:56.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:56.109734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:08:56.110594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:56.114506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 323/664] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/services/network => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:56.118784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.119683 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.120042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.120406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.120902 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.121311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:56.121733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.123601 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.125288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.138380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 342/665] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:08:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:56.143133 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.302273 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ba60a-1697-460e-8db7-2195cc8c4b85 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.316225 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d92968-3d86-4572-ae19-750efd144003 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.344666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.345347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.345727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.346082 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.346826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:56.347189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.348645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.362396 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 343/666] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:56.387410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.388621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.388955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.389223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.389984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] RBAC: Adding query filter params (name=network) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:56.390281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.392084 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ea18b-3082-4b85-aaa5-96c286532721 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.395128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.402978 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 324/667] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:56.405326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:56.513515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:56.593123 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cb223-1cf5-4b08-838e-a63fc142c348 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:56.656739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:56.657430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:56.657706 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:56.657973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:56.658686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:56.658985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:56.660377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42d73d-0914-4eba-8672-a5ebb3284fa5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:56.668362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 344/668] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:08:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:08:57.483439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1cc5-a089-49cd-bafa-f9716fb00c85 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.484410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1cc5-a089-49cd-bafa-f9716fb00c85 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.484904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb1cc5-a089-49cd-bafa-f9716fb00c85 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.486779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 325/669] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:57.492411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4009-3034-46d5-b292-4645b0a50942 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:57.493255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4009-3034-46d5-b292-4645b0a50942 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:57.493726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4009-3034-46d5-b292-4645b0a50942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:57.513129 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b78e4009-3034-46d5-b292-4645b0a50942 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:57.514677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b78e4009-3034-46d5-b292-4645b0a50942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:57.588120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 345/670] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:57.912845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1cc5-a089-49cd-bafa-f9716fb00c85 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:58.022134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb1cc5-a089-49cd-bafa-f9716fb00c85 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:58.060837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:58.062121 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:58.062631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:58.063104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:58.063988 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:58.065583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ce1a0-e0ab-4d8f-be99-798913c67596 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:58.086627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 326/671] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:08:57 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:58.635255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb2cc-f886-4704-b790-d9cbc614ffa6 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:58.636042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb2cc-f886-4704-b790-d9cbc614ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:58.636042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb2cc-f886-4704-b790-d9cbc614ffa6 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:58.638002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 346/672] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:58.643660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeec09-1ce5-4972-824d-b0b797b601b9 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:58.644151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeec09-1ce5-4972-824d-b0b797b601b9 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:58.644227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeec09-1ce5-4972-824d-b0b797b601b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:58.665163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-2edeec09-1ce5-4972-824d-b0b797b601b9 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:58.666432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-2edeec09-1ce5-4972-824d-b0b797b601b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:58.763662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:58.793636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 327/673] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:58 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:59.005889 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7e0c-cac2-4fca-b665-0f04dfe4d0f3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.006293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7e0c-cac2-4fca-b665-0f04dfe4d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.006508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7e0c-cac2-4fca-b665-0f04dfe4d0f3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.007825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 347/674] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:59.013969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.014251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.014491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.035835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:59.037478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:59.116286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 328/675] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:59 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:59.454834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7e0c-cac2-4fca-b665-0f04dfe4d0f3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:59.457854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:59.523275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:59.577882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7e0c-cac2-4fca-b665-0f04dfe4d0f3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:59.627110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff6e3-bd79-4c77-802b-2c37f495da51 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:59.628014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:59.628968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.630229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.630680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.631489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:59.633159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69dd0b-6055-45fb-92ba-9e2cbc878c86 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:59.647091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:08:59.656001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 348/676] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:08:59 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:08:59.657637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897061c-960b-452a-ad17-c786bd2c85c2 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.658058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897061c-960b-452a-ad17-c786bd2c85c2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.658509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897061c-960b-452a-ad17-c786bd2c85c2 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.660193 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 349/677] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:08:59.667333 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.668126 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.668818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.698563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:59.699801 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.700858 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.701454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.712151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:08:59.713532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:08:59.725143 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:08:59.737742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:08:59.739664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:08:59.741349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:08:59.752227 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 329/678] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:08:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:08:59.755365 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:08:59.823261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 350/679] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:08:59 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 11:08:59.905624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbf972-57a4-44f1-8329-227e00345524 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:08:59.944813 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:08:59.945447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:08:59.945721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:08:59.945990 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:08:59.946701 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:08:59.947176 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:08:59.948924 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:08:59.959907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 330/680] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:08:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:08:59.969981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.036124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.110149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef7019-d0c1-4922-b72d-544a7c3d28f2 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.148943 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.149602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.149879 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.150147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.162806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.164435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:09:00.183002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:00.185265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:09:00.187417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:09:00.187417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:00.187417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:00.187417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 351/681] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:00.197442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.268654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.360068 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.399343 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd65b-8ec7-4e3c-bbd4-6dd8c3bbc9cd None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.482531 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.483514 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.483514 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.483790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.484456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:00.484760 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.486184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.491187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.495777 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6485f-ec28-41be-b57e-4199d3105256 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.512624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 331/682] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:00.520282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.557870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.559704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.560212 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.560731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.562198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.565178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.601594 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 352/683] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:09:00 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:09:00.639961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:00.648467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49648292-8919-496e-a9fe-2a2b47d820c2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.716710 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.717751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.718228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.718723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.733711 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.735576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-445c3cd1-7aad-480a-ab51-17a86414e4e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:09:00.749889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:00.750942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:09:00.751877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:00.755148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 332/684] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:00.765173 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:00.782451 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd29c-767b-4e5e-b6ac-9fd5f0912d7d None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.783422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd29c-767b-4e5e-b6ac-9fd5f0912d7d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.784010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd29c-767b-4e5e-b6ac-9fd5f0912d7d None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.788058 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 333/685] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:00.794015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.794624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.795082 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.818916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:00.820856 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:00.927355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a631cd-f3da-4072-9186-aaf53763f2c5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:00.935702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 334/686] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:00.971437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:00.972186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:00.976384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:00.976384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:00.976384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:00.976384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:00.976384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:00.999672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 353/687] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:09:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:01.005659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.106883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:01.116864 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2f58d-b0ea-45b6-989e-daed0db26bbf None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.173105 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.174283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.174838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.175333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.195746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.198595 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:09:01.227660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:01.228677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:09:01.229589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:09:01.229589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:01.229589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:01.230187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 335/688] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:01.236614 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.257301 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:01.351513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90b89b-712e-4587-a016-41bd8f669898 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.388861 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.389800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.390281 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.390818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.391663 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:01.392218 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.393821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:01.406828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 354/689] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:01.412263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.510091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.529871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770c11e-d2a0-46b9-a129-03d397979fff None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.563397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:01.570000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.570673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.570992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.571290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.581141 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.582609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:09:01.596869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:01.598685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:01.600507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:01.602810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 336/690] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:01.604684 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.694317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:01.745397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f472376-edab-4022-b6f6-01fde4426dab None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.748577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238040f-52c0-4e0f-8c13-49c3b488575b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.790730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.791340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.791621 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.791884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.792580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:01.792880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.794432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:01.813884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 337/691] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:01.815534 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.817555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.818843 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.819333 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.819809 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] PATH_INFO: `/v3/services/image` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.820592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.822232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:01.835313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:01.836441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:01.837286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:01.845677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 355/692] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/services/image => generated 86 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:01.847465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:01.880838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:01.942457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876ddd2-a91a-4e52-a40f-5812e426de9f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.979583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddfc1d-042a-4249-b3b2-5ea3827c5595 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:01.990597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:01.991265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:01.991541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:01.991810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/a8460d3ea12e4126b928a51cd29587df/roles/812192d969e9436d9845f219dd311628` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:01.993788 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=a8460d3ea12e4126b928a51cd29587df, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:01.995269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:02.022451 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 338/693] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:09:01 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/a8460d3ea12e4126b928a51cd29587df/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:09:02.039776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:02.040961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.041473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.042043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.043074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] RBAC: Adding query filter params (name=image) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:02.044219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:02.046146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:02.052688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 356/694] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:02.059321 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:02.198090 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66634bf6-5493-4adb-886a-eee09a814c6e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:02.214955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:02.242759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:02.243365 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.243686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.243955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.244685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] RBAC: Adding query filter params (type=image) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:02.245031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:02.247061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300ad67-ad34-443d-8a60-ad61387adeff None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:02.253480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 339/695] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:02.259583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:02.270672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:02.283506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4194a5-60f0-4b63-8c7b-b1d8dc22dc35 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.283954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4194a5-60f0-4b63-8c7b-b1d8dc22dc35 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.284428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4194a5-60f0-4b63-8c7b-b1d8dc22dc35 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.287280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 340/696] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:02.296579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.297064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.297543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.328086 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:02.329453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:02.404978 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff47ac-d73e-4f9f-bb37-1f01da678286 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:02.466182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:02.467074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.467355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.467760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.468534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] RBAC: Adding query filter params (interface=public, service_id=7d1cdab12a54473bbbe5e2f4ccb16857, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:02.468896 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:02.470340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:02.479265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 341/697] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:02.482718 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 357/698] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:02 2022] GET /identity/v3/endpoints?service_id=7d1cdab12a54473bbbe5e2f4ccb16857&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:02.488056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:02.611035 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199502f6-7023-400a-864d-aa3d7278f024 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:02.619701 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:02.651375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:02.652049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:02.652333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:02.653163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:02.653826 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:02.655271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:02.661841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 342/699] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:02 2022] GET /identity/v3/services => generated 1002 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:03.071487 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:03.199577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:03.264880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec9604-b942-42c2-9853-68054a6a6667 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:03.332408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:03.334043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.334861 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.335610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.336959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:03.340537 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:03.358312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:03.360149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:03.361710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:03.370557 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 358/700] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 9 11:09:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:03.376015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:03.567632 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c389df-24b8-4ba0-b1a7-19c17ba3245f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:03.635163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:03.638059 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.638909 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.639675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.641074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:03.641885 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:03.644776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7005fa-036c-4777-b3d9-ce501d0c0406 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:03.658284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 343/701] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:09:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:03.663723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:03.774860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975fb47-16d0-4a3e-81bf-c7a06fbc24ce None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.775301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975fb47-16d0-4a3e-81bf-c7a06fbc24ce None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.775583 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975fb47-16d0-4a3e-81bf-c7a06fbc24ce None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.778806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 344/702] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:03.783320 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.783651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.783895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.803976 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:03.804719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:03.842301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:03.864705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe775-2f64-4020-8c5e-dad90605f816 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:03.898638 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 345/703] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:03.930089 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:03.939541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:03.940990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:03.941741 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:03.942550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:03.943958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:03.944746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:03.947532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:03.958404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 359/704] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:09:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:03.968118 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:04.118756 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fd5d4-f8de-4e45-8804-d2f2256d2998 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:04.157311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:04.158395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:04.158932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:04.159405 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:04.160356 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] RBAC: Adding query filter params (interface=public, service_id=c13667d7910440f0aa9741d13c053416, region_id=RegionOne) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:04.160920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:04.162571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:04.172576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 346/705] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:03 2022] GET /identity/v3/endpoints?service_id=c13667d7910440f0aa9741d13c053416&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:04.178837 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:04.242070 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:04.276088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:04.299493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0272e-aa1e-4bf4-94c3-0dc159b2e063 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:04.338513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:04.339609 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:04.340665 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:04.341140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:04.341942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:04.343634 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:04.358944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 360/706] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:04 2022] GET /identity/v3/services => generated 1002 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:04.365350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26114b29-d2fe-4573-8624-8d3cc78249ac None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:04.410399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:04.411027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:04.411316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:04.411590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] PATH_INFO: `/v3/services/network` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:04.412191 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:04.413673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:04.424983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:04.426049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:04.427422 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 347/707] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:04 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:04.436344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:04.518171 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:04.591699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b3198-bc53-4d04-92cf-17d21f79398e None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:04.641162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:04.641781 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:04.642067 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:04.642329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:04.643000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] RBAC: Adding query filter params (name=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:04.643305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:04.644698 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:04.654511 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 361/708] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:04.660568 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:04.821000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:04.837898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec39e71-03c8-431a-ab44-39cb5b68d818 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:04.904852 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:04.905904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:04.906445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:04.906951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:04.908156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] RBAC: Adding query filter params (type=network) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:04.908717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:04.911880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:04.923348 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 348/709] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:04.930827 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:05.056828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486df74-a542-4f1f-9197-cdefb9a48865 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:05.214972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:05.235265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:05.236756 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.237528 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.238262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.239848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] RBAC: Adding query filter params (interface=public, service_id=6772456a789346f0a1509caf9987d723, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:05.240674 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:05.243548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6bf59-4dcd-4eb3-8929-eb53dfa70db6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:05.258836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 362/710] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:04 2022] GET /identity/v3/endpoints?service_id=6772456a789346f0a1509caf9987d723&interface=public®ion_id=RegionOne => generated 194 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:05.266180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:05.378337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95e8b3-164b-408f-b9f8-ef91afb17921 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:05.386421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd147f-b4ab-4a03-8d64-1c54197e25e2 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.387324 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd147f-b4ab-4a03-8d64-1c54197e25e2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.387523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd147f-b4ab-4a03-8d64-1c54197e25e2 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.389045 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 363/711] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:05.395024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.395309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.395568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.418750 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:05.419952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:05.426496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:05.427865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.429064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.429565 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.430451 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:05.434063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8ae9-4798-426e-afe0-058f219913b3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:05.444535 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 349/712] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:05 2022] GET /identity/v3/services => generated 1002 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:05.490457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcdc7-90aa-4dde-9448-2ff4e74e9a94 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.490457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcdc7-90aa-4dde-9448-2ff4e74e9a94 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.490457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bcdc7-90aa-4dde-9448-2ff4e74e9a94 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.490457 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 350/713] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:05.497742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:05.498073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:05.498301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:05.521786 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:05.523948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:05.545518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:05.551661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 364/714] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:05.641912 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 351/715] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:05.977298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.086176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db17628-f7c2-43eb-b5a5-07efe2ef70ac None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.110952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:06.123532 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.124182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.124460 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.124731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] PATH_INFO: `/v3/services/image` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.125321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.127064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.127781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:06.137538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:06.138602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:06.139437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 365/716] 10.222.0.25 () {56 vars in 1105 bytes} [Fri Sep 9 11:09:05 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:06.144811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.290520 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8308f2-4cfd-4646-859b-c82ad1d7783c None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.321894 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5904f-c43f-423f-a74c-9fc7945223ec None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.347186 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.348420 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.349031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.349647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.366199 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.366888 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.367132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.367408 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.368239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] RBAC: Adding query filter params (name=image) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:06.368714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.369301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:09:06.370092 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.376358 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 366/717] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:09:06.380442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:06.382519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:09:06.384612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:06.395093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 352/718] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:06.395384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.395605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.413129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:06.472613 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:06.554593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d34a6-aa72-476c-b3f3-71ce4972ea5c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.577991 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd2be8-89ac-4068-95c0-414dc68452f2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.601063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.602052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.602624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.603100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.603962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] RBAC: Adding query filter params (type=image) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:06.604476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.606782 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.612893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 367/719] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:06.619738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.624580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.625541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.626126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.626647 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.627575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:06.628103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.629900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.640497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 353/720] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:06.647012 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:06.739495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:06.772910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1541cb-ac97-4c7f-b8fe-f8c4aeda8e0b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.778334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf531-8863-41f1-9bcc-1a5dffa51faa None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:06.789147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:06.824164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.825272 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.825775 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.826401 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.827284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.828845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:06.829295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.829660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:06.829940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:06.830208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:06.844074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:06.845614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:06.858647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 368/721] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:09:06.867015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:06.868062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:09:06.869054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:09:06.869054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:06.869054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:06.871671 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 354/722] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:06.878412 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.027788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97002767-ffd8-4d62-ac45-12a9e62d44af None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.071641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.072667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.073176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.073655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.075259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:07.075786 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.077488 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a0654-88b5-442d-bbb2-61b81b3c7adb None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.091870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 369/723] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:07.097746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.167059 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b15a2-6505-4028-930c-bbc9a6abe61e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.167337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b15a2-6505-4028-930c-bbc9a6abe61e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.167888 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b15a2-6505-4028-930c-bbc9a6abe61e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.169591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 370/724] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:07.176798 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.177117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.177346 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.200046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:07.201428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:07.221452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.229801 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f3216-88ca-4884-8dd5-035229d36502 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.265470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.282529 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.283195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.283499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.283750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.290481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 371/725] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:07 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:07.292832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.294432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:09:07.307402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:07.309056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:07.311009 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 355/726] 10.222.0.25 () {56 vars in 1093 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:07.315355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.433142 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5ecbf-5358-40e4-8f34-be953d47b14e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.472655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.473274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.473555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.473830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.474606 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:07.474917 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.476466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.497290 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 372/727] 10.222.0.25 () {56 vars in 1133 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:07.502918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.622526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fa412-48f4-4616-8f9c-15b07249d8d0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.645915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.662240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.665901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.666633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.666915 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.667185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.729159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.748618 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.750380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.767900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849652d0-ecbe-4654-9aa3-3659383acafc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.806036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:07.806899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:07.807593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:07.807593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:07.808890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:07.810740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:07.821138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:07.822591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 11:09:07.823770 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:07.825152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 373/728] 10.222.0.25 () {56 vars in 1129 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:07.830944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.865761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 356/729] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:09:07.871871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:07.928556 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.965127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:07.980278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e043c5-6dd3-47f4-8367-45f03230b502 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:07.983107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e48f-ef90-48e9-9150-ff37fc3a97ac None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.020383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.021440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.021779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.022122 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.033751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.035464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.041680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.043621 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.044951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.045617 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.048035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:08.048819 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.051370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:09:08.052970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:08.054679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:09:08.056317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:09:08.056317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:08.056317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:08.056317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 357/730] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:08.063383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.064677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 374/731] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:09:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:08.072579 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.189357 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854acfb-ccdc-412f-bc4d-94468307f7bc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.200663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7a209-60dc-458d-9b40-4bb7764fe9da None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.236053 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.236614 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.236891 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.237160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.237804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:08.238105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.239555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.247409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 375/732] 10.222.0.25 () {56 vars in 1124 bytes} [Fri Sep 9 11:09:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:08.252857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.257851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:08.262475 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.263472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.263960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.264463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.266763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:08.267340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.269916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.274520 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:08.289268 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 358/733] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:08.297656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.374444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb89e4-751f-460e-be13-ca1116c19dd2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.410798 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.411329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.411648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.411847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.412583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.414015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.421849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348b598-6de0-42c2-9fb5-14e2aa71a2a3 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.442639 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 376/734] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:09:08.473404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.474463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.474957 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.475416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.484703 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.486642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-962ad1fc-a12f-4021-b8f8-c0cb8f174294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:09:08.500845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:08.501838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:08.502803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:08.505226 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 359/735] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:08.512496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.592332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:08.645468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feadede-700f-4276-9962-e9d8ba15f6c5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.661717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de9ae-5897-4635-9ffe-0cb5298b6549 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.663168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de9ae-5897-4635-9ffe-0cb5298b6549 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.663677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de9ae-5897-4635-9ffe-0cb5298b6549 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.665709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 360/736] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:08.672486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.673144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.673634 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.692129 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.692763 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.693042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.693314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.694018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:08.694326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.695816 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.696320 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:08.697947 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:08.711009 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 377/737] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:08.717548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:08.757780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:08.787261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 361/738] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:08 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:08.846617 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909165c6-6bad-4882-ad22-ef1f87a5a155 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:08.867420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:08.887476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:08.888097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:08.888428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:08.888727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:08.889470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=a8460d3ea12e4126b928a51cd29587df) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:08.889783 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:08.891338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:08.898398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 378/739] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:09:08 2022] GET /identity/v3/role_assignments?user.id=a8460d3ea12e4126b928a51cd29587df&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=812192d969e9436d9845f219dd311628 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:09.122723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:09.243300 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15149a-f3f9-4ade-9477-ecc7437e0aa5 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:09.291614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:09.292763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.293415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.293892 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] PATH_INFO: `/v3/services/network` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.294766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:09.296903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:09.308428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:09.309567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 11:09:09.311172 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:09.318559 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 362/740] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:09 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:09.320235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:09.448817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c1949-7740-4624-add6-b18c73c4d438 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:09.487863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:09.488522 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.488806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.489085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.489723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:09.490067 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:09.491466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac91e7-3ba3-444a-bbdd-7d369da541e0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:09.497085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 379/741] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:09.503137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:09.505332 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61703f-9872-486b-8145-a11621f9f7fd None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.505613 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61703f-9872-486b-8145-a11621f9f7fd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.505887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61703f-9872-486b-8145-a11621f9f7fd None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.511431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 380/742] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:09.515561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.515853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.516181 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.538369 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:09.539746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:09.568459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:09.592165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:09.622633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 381/743] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:09 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:09.675687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc30ec-8037-4b09-835c-5a5a0520e60b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:09.729031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:09.730791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.731500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.732460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.733888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] RBAC: Adding query filter params (type=network) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:09.734759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:09.740044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:09.754824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 363/744] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:09.763521 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:09.876169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205385-513a-487d-b154-5244c9b022f4 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:09.915170 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:09.916102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:09.916547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:09.916986 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:09.918794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:09.921119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:09.951361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:09.961772 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 382/745] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:09:10.102271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ffe4a-ace4-4225-872d-ff903540fb59 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.114967 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:10.153349 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.153969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.154251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.154558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.239616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.241524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.355169 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 364/746] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:09:09 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:09:10.360501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:10.398860 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:10.481909 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a1d33-b749-48d4-95a4-5630198b5216 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.517937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.518621 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.518893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.519179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.531579 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.533122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-9da0ccbf-4866-4fd3-b095-94c48297cb86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:09:10.548928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:10.549963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:09:10.550900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:09:10.550900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:09:10.550900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:10.554467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 383/747] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:10.556258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:10.566231 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:10.665228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace36ee-3ea0-4c6e-b943-265632099cd4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:10.711370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:10.712012 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:10.712273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:10.712501 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:10.713168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:10.713465 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:10.715402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea69c39-cd6c-4021-8110-2f04f6bf766c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:10.734393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 365/748] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:11.184299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc876d-d648-4efe-b809-d0d2e3588963 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:11.184585 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc876d-d648-4efe-b809-d0d2e3588963 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:11.184846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc876d-d648-4efe-b809-d0d2e3588963 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:11.186466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 384/749] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:11.192077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:11.192404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:11.192677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:11.212700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:11.213958 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:11.280653 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:11.289281 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 366/750] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:11 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:11.624697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc876d-d648-4efe-b809-d0d2e3588963 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:11.724962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:11.744434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc876d-d648-4efe-b809-d0d2e3588963 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:11.780792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:11.781424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:11.781700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:11.781968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:11.782590 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:11.783954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:11.794104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:11.796147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:11.798056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 385/751] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:11.801485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:11.910602 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fd252-7ed2-41a6-8616-c2d6c6ba9b3f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:11.950005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:11.950648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:11.950930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:11.951198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:11.951823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:11.952125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:11.953506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca59845-d7d0-41d3-8dc9-ff8abeab60f0 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:11.958675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 367/752] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:11.964644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:12.099900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84c75-7962-4b8b-b62e-08cdcc29cf57 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:12.138154 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:12.138793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:12.139089 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:12.139347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:12.139979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:12.140282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:12.141636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2670f-502c-4e65-ba47-a11be1911261 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:12.146738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 386/753] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:12.276979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325765-5d52-4e0d-86fb-e4730b2f5f6a None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:12.277319 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325765-5d52-4e0d-86fb-e4730b2f5f6a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:12.277505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84325765-5d52-4e0d-86fb-e4730b2f5f6a None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:12.278923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 368/754] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:12.285837 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:12.286335 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:12.286855 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:12.318886 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:12.320836 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:12.335846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:12.423714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 387/755] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:12 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:12.751497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84325765-5d52-4e0d-86fb-e4730b2f5f6a None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:12.815158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:12.864678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84325765-5d52-4e0d-86fb-e4730b2f5f6a None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:12.907326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:12.907988 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:12.908270 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:12.908546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:12.909151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:12.911337 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:12.926732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:12.930857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:12.931804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 369/756] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 9 11:09:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:12.935932 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:13.048088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815b299-85e1-4315-a47e-1e0f410189e0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:13.085104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:13.085739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:13.086019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:13.086290 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:13.087041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:13.087344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:13.089282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c27d8-1810-4e1a-8342-216530188d9e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:13.094292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 388/757] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:13.103698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:13.209750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf4a5-d957-4359-a409-ae190c6f9d02 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:13.234743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:13.247604 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:13.248240 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:13.248514 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:13.248781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:13.249437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:13.249738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:13.251543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5af0a-e1f6-4e6f-bf2a-14f2b53b4cb9 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:13.256959 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 370/758] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:14.615395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cef-b14b-4f3a-8ff7-d92714ac7b8f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:14.616084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cef-b14b-4f3a-8ff7-d92714ac7b8f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:14.616084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df204cef-b14b-4f3a-8ff7-d92714ac7b8f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:14.617701 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 389/759] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:14.624354 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160aa90-5bdc-4955-9325-5d5b5efca23e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:14.624945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160aa90-5bdc-4955-9325-5d5b5efca23e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:14.624945 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160aa90-5bdc-4955-9325-5d5b5efca23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:14.644267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-9160aa90-5bdc-4955-9325-5d5b5efca23e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:14.645463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-9160aa90-5bdc-4955-9325-5d5b5efca23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:14.736545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 371/760] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:14 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:15.068657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204cef-b14b-4f3a-8ff7-d92714ac7b8f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:15.078424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:15.182083 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df204cef-b14b-4f3a-8ff7-d92714ac7b8f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:15.219172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:15.219787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:15.220066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:15.220338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:15.220992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:15.222423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d764-f031-424f-9ad8-aa3b21c1fa4b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:15.238400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 390/761] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:09:15 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:15.704543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf3aa-0b8d-48a6-b6c3-9b49c73228e7 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:15.705092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf3aa-0b8d-48a6-b6c3-9b49c73228e7 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:15.705092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf3aa-0b8d-48a6-b6c3-9b49c73228e7 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:15.706678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 372/762] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:15.712295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45df3-c629-4d2e-ae5d-62d28fcb97c2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:15.712799 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45df3-c629-4d2e-ae5d-62d28fcb97c2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:15.712916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45df3-c629-4d2e-ae5d-62d28fcb97c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:15.732900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-5db45df3-c629-4d2e-ae5d-62d28fcb97c2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:15.734184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5db45df3-c629-4d2e-ae5d-62d28fcb97c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:15.797431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:15.813311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 391/763] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:15 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:16.141665 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf3aa-0b8d-48a6-b6c3-9b49c73228e7 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:16.257866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf3aa-0b8d-48a6-b6c3-9b49c73228e7 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:16.276840 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:16.294864 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:16.295472 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:16.295744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:16.296007 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:16.296657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:16.298039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6384e-502c-44bb-9b7e-ae905339a75c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:16.314719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 373/764] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:09:16 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:17.758278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc22a8-301a-4187-b778-e4b3df163865 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:17.758870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc22a8-301a-4187-b778-e4b3df163865 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:17.758870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc22a8-301a-4187-b778-e4b3df163865 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:17.760263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 392/765] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:17.765723 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:17.766159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:17.766415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:17.785441 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:17.786656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:17.860263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 374/766] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:18.196913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc22a8-301a-4187-b778-e4b3df163865 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:18.297830 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc22a8-301a-4187-b778-e4b3df163865 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:18.341703 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:18.342468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.342802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.343124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.343767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:18.345249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:18.355577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:18.356638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:18.357635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 393/767] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:18.362854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:18.473970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2d407-2e30-4575-a823-b35e696d7505 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:18.476662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:18.512766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:18.513378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.513657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.513930 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.514600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:18.514903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:18.516275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:18.525912 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 375/768] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:18.527195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:18.588655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:18.640387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980e73-ac85-46e8-a6a1-7972282f5247 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:18.678623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:18.679250 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.679529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.679802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.680444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:18.680742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:18.682291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffea2e1-5e12-4004-9aa7-69f575da0a53 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:18.688276 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 394/769] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:18.694494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:18.758070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc264-b74b-4946-803b-ff7c2bc8289f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.758472 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc264-b74b-4946-803b-ff7c2bc8289f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.759251 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc264-b74b-4946-803b-ff7c2bc8289f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.761197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 395/770] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:18.767265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.767615 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.768047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.787796 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:18.789130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:18.821623 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14825-f7cf-4314-be80-a17a95ede7a8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:18.866648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:18.867830 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:18.867830 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:18.868207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:18.869047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 396/771] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:18 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:18.869954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] RBAC: Adding query filter params (interface=public, service_id=e7c6b480caed4631a4f40183a2fa045f, region_id=RegionOne) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:18.870474 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:18.872979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:18.881018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 376/772] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:18 2022] GET /identity/v3/endpoints?service_id=e7c6b480caed4631a4f40183a2fa045f&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:18.887384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:18.949824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:19.003698 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b5d4-31b2-4438-9574-7a469fe5769e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:19.038963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:19.039451 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:19.039726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:19.039996 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:19.040595 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:19.042516 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:19.048719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 397/773] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:18 2022] GET /identity/v3/services => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:19.201336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:19.237655 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:19.312846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cdb28-6220-4033-a89b-8893dc095f5b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:19.346862 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:19.347495 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:19.347774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:19.348045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:19.348626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:19.350015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:19.359741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:19.361508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:19.363256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 377/774] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 9 11:09:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:19.366948 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:19.476181 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ec05e-6199-404b-a085-f5b798ccdba0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:19.493778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:19.519194 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:19.520100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:19.520506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:19.520938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:19.521914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:19.522325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:19.524221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:19.536316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 398/775] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:19.537608 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:19.657743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:19.665233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ae791-3ee1-4bb3-83b0-2e6df09a01e7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:19.704882 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:19.705491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:19.705765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:19.706034 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:19.706704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:19.707001 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:19.708387 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:19.714181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 378/776] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:19.720287 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:19.825459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97732c-58db-489d-aded-1c779c0b6dbc None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:19.866163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:19.866890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:19.867258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:19.867608 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:19.868385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] RBAC: Adding query filter params (interface=public, service_id=a7853f08ef154c9bb46885cc1ce6373f, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:19.868749 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:19.870389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e01a0-73b1-4c84-8cd1-be2cab472ec5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:19.881217 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 399/777] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:19 2022] GET /identity/v3/endpoints?service_id=a7853f08ef154c9bb46885cc1ce6373f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:19.883265 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:20.027287 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e05bbd-2fb7-44fc-8d8a-7725cdbcb1ec None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:20.067458 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:20.068105 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:20.068445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:20.068776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:20.069445 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:20.070994 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbce5e-bd84-44b7-bdc3-e077c4de9ced None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:20.077808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 379/778] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:19 2022] GET /identity/v3/services => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:21.539514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21cb1f-4c6a-4459-b314-5298cf9e324b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:21.540064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21cb1f-4c6a-4459-b314-5298cf9e324b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:21.540302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21cb1f-4c6a-4459-b314-5298cf9e324b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:21.542658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 400/779] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:21.548256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:21.548832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:21.548832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:21.568654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:21.569842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:21.589158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:21.642299 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 380/780] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:21 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:21.989328 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21cb1f-4c6a-4459-b314-5298cf9e324b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:22.044236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:22.131214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21cb1f-4c6a-4459-b314-5298cf9e324b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:22.188542 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:22.189515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.189940 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.190395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.191326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:22.193603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:22.209360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:22.210650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:22.211980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 401/781] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:22.220956 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:22.375397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17545552-db6a-481f-ab85-ac2a2eff9c44 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:22.426960 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:22.427881 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.428313 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.428720 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.429704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:22.430157 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:22.433014 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17934f-98a9-4f4e-a14f-46e014c69841 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:22.450291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 381/782] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:22.451199 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:22.564366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf13e9b-0bd5-4636-885e-cf9fc15888a5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:22.567310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43552-1020-4797-a0c1-e327837dd386 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.568039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43552-1020-4797-a0c1-e327837dd386 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.568197 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43552-1020-4797-a0c1-e327837dd386 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.569732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 382/783] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:22.573070 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:22.576560 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.576849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.577127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.596525 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:22.598041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:22.605330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:22.605938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.606215 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.606519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.607159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:22.607465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:22.608846 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:22.616048 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 402/784] 10.222.0.25 () {56 vars in 1114 bytes} [Fri Sep 9 11:09:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:22.617588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:22.622840 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:22.680528 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 383/785] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:22 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:22.791686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bc1d-6430-4951-91bb-ea30c8a4bb17 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:22.833870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:22.834515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:22.834794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:22.835066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:22.835811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:22.837184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:22.861672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 403/786] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:09:23.017780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:23.137989 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68ff51-5f81-4477-8f10-740e819ccb71 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:23.185158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:23.185803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:23.186080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:23.186371 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:23.186965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:23.188342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:23.198288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:23.199845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:23.201536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 384/787] 10.222.0.25 () {56 vars in 1132 bytes} [Fri Sep 9 11:09:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:23.206230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:23.248353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:23.343595 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c11ab5-28a1-4d08-94ae-8be0dfc4ec50 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:23.380788 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:23.381477 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:23.381759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:23.382029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:23.382766 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:23.383066 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:23.385030 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:23.390450 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 404/788] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:23.396719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:23.409469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:23.531269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574d1a9-23b7-452b-80b2-9e41bdfa35f6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:23.568336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:23.569052 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:23.569194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:23.569469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:23.570104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:23.570439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:23.571871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e269ecd-884c-425e-a68e-83af804ae741 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:23.577465 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 385/789] 10.222.0.25 () {56 vars in 1126 bytes} [Fri Sep 9 11:09:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:23.583347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:23.689942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:23.703494 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3c0e-c512-4f29-addf-2d35ae7d2ef2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:23.739531 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:23.740143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:23.740420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:23.740689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:23.741375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:23.742793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f035c-0c0d-4896-8bbd-20c172beed8c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:23.778383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 405/790] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:25.462773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2f4-8fdb-4126-929c-cda03656578c None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:25.463294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2f4-8fdb-4126-929c-cda03656578c None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:25.463294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f2f4-8fdb-4126-929c-cda03656578c None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:25.464786 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 386/791] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:25.469853 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:25.470310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:25.470431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:25.489646 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:25.490862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:25.569168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 406/792] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:25 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:25.896144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f2f4-8fdb-4126-929c-cda03656578c None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:25.973130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:26.027919 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f2f4-8fdb-4126-929c-cda03656578c None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:26.070340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:26.071001 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.071312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.071644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.072301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:26.073764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:26.076539 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING keystone.server.flask.common [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 11:09:26.097291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.sql.core [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:09:26.097291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:09:26.097291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [parameters: {'id': '0c73feb0a29e4a6c8f0eb24f038adb70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:09:26.097291 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-986ca448-c107-4680-96ec-29924b1a5ab4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c73feb0a29e4a6c8f0eb24f038adb70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c73feb0a29e4a6c8f0eb24f038adb70. Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:09:26.114253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application result.read() Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 11:09:26.115293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application yield resource Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise self.value Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application session.commit() Sep 09 11:09:26.117350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:09:26.119094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:09:26.121126 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application result.read() Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:09:26.122969 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [parameters: {'id': '0c73feb0a29e4a6c8f0eb24f038adb70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.125024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:26.126913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0c73feb0a29e4a6c8f0eb24f038adb70. Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.128727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 387/793] 10.222.0.25 () {60 vars in 1140 bytes} [Fri Sep 9 11:09:25 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:26.129854 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:26.214039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0556a-5221-4545-9fd0-103f90c7442b None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.214230 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0556a-5221-4545-9fd0-103f90c7442b None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.214531 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0556a-5221-4545-9fd0-103f90c7442b None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.217385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:26.218866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 388/794] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:09:26.224633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.224904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.225180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.244798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:26.246336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:26.251953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f06d0-9865-4ba7-95ab-59dad2ff28f5 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:26.289523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:26.290209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.291103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.291379 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.299423 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:26.300874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:09:26.312925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:26.314105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:26.315409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 407/795] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:09:26.319829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:26.322329 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 389/796] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:26 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:26.428686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3545c-e402-458b-b88d-80222e18d62a None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:26.465914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:26.471456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:26.472084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.472325 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.472595 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.473253 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:26.473550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:26.475060 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:26.502626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 408/797] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:09:26.645580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:26.713022 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:26.759869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cf572-a35c-488a-a244-fbfd79a66df2 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:26.795437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:26.796079 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.796358 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.796629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.797213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:26.798742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:26.808294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:26.809783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:26.811057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 390/798] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:26.815565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:26.920126 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e181-19f5-44fe-8103-86ecef6c5a12 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:26.958992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:26.959625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:26.959903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:26.960174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:26.960828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:26.961132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:26.962690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3080-8633-4291-9a61-f893f314cf15 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:26.967930 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 409/799] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:26.973893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:27.104907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e9a5-c09a-4e55-8b84-aa5fc989472b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:27.129229 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:27.144327 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:27.144936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:27.145214 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:27.145491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:27.146127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:27.146461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:27.147847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3ad6-bca5-40fe-8c38-b7af6de0abdc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:27.153525 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 391/800] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:29.020434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475c4-cfa9-4a01-8983-eee4ef57e30f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.021010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475c4-cfa9-4a01-8983-eee4ef57e30f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.021010 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f475c4-cfa9-4a01-8983-eee4ef57e30f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.022316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 410/801] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:29.031257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9bef8-e6b9-4bc6-94c4-6266f9f74f72 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.032026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9bef8-e6b9-4bc6-94c4-6266f9f74f72 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.032321 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9bef8-e6b9-4bc6-94c4-6266f9f74f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.053769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-70c9bef8-e6b9-4bc6-94c4-6266f9f74f72 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:29.056803 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-70c9bef8-e6b9-4bc6-94c4-6266f9f74f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:29.134049 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 392/802] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:29.459501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f475c4-cfa9-4a01-8983-eee4ef57e30f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:29.516593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:29.561213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f475c4-cfa9-4a01-8983-eee4ef57e30f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:29.594117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:29.594748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.595027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.595295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.595931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:29.597344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:29.599887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING keystone.server.flask.common [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 11:09:29.612405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.sql.core [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:09:29.612405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:09:29.612405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [parameters: {'user_id': 'c8275e8296ec40c6812361f2f0f373bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:09:29.612405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88294) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 11:09:29.615042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bb1-8807-47df-b948-ff6feb205503 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.615326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bb1-8807-47df-b948-ff6feb205503 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.615598 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bb1-8807-47df-b948-ff6feb205503 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.617097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 393/803] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:29.625518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.625518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.625518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Sep 09 11:09:29.628785 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:09:29.629633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application yield resource Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application next(self.gen) Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise self.value Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application session.commit() Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 11:09:29.630638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.session.flush() Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application compat.raise_( Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 11:09:29.631677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 11:09:29.633029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application conn.query(q) Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application result.read() Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 11:09:29.634699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c8275e8296ec40c6812361f2f0f373bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:29.635744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 11:09:29.636834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.637924 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 411/804] 10.222.0.25 () {60 vars in 1131 bytes} [Fri Sep 9 11:09:29 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:29.638569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:29.642591 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:29.643778 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:29.715370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 394/805] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:29 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:09:29.743842 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8c8a4-e606-4e91-8356-aa65b014f6c8 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:29.761132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:29.779299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:29.779925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.780206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.780482 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.787869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:29.789467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:09:29.800426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:29.801539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:29.802752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 412/806] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:09:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:29.807765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:29.855505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:29.907754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597efe31-4539-466b-bd9c-fc730a8f8844 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:29.942462 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:29.943066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:29.943342 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:29.943613 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:29.944305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:29.944611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:29.946021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba21503-1877-4f9f-940b-84fd51601489 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:29.980558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 395/807] 10.222.0.25 () {56 vars in 1101 bytes} [Fri Sep 9 11:09:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:30.042622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:30.161507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae67a2a-97a7-4a62-bf94-168d579553b6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:30.197425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:30.198131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:30.198438 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:30.198710 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:30.199361 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:30.200714 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ca0d-1573-4db2-a2c6-20222515a40e None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:30.218131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 413/808] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:09:30 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:32.627447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860238ad-f5e9-457c-b0c6-a5aacef904dd None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:32.628017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860238ad-f5e9-457c-b0c6-a5aacef904dd None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:32.628017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860238ad-f5e9-457c-b0c6-a5aacef904dd None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:32.629295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 396/809] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:32.635447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:32.635914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:32.636022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:32.655228 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:32.656824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:32.688716 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:32.733961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 414/810] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:32 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:33.054769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860238ad-f5e9-457c-b0c6-a5aacef904dd None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:33.155739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860238ad-f5e9-457c-b0c6-a5aacef904dd None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:33.157986 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:33.189194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:33.189814 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:33.190093 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:33.190392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:33.190974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:33.192360 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:33.201442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:33.202617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:09:33.203847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 397/811] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:33.208493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:33.307463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae088-1725-42f7-b3d1-0180ca70205c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:33.341019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:33.341620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:33.341896 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:33.342163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:33.342815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:33.343115 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:33.344473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:33.349151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 415/812] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:33.355504 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:33.455577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc72cd-52f3-4c4c-b864-3e55360c8ef1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:33.488555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:33.489144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:33.489419 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:33.489688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:33.490305 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:33.490632 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:33.491973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:33.497088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 398/813] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:33.503239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:33.531330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:33.604340 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcfabe-2fca-47e1-8f68-0908554831b9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:33.639027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:33.639671 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:33.639893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:33.640165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:33.640857 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] RBAC: Adding query filter params (interface=public, service_id=8fac0b91f0754092bc984d4b0f31df08, region_id=RegionOne) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:33.641165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:33.642580 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96bfe6-7027-416f-87cf-3b6400896748 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:33.647483 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 416/814] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:09:33 2022] GET /identity/v3/endpoints?service_id=8fac0b91f0754092bc984d4b0f31df08&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:33.653853 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:33.685255 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:33.750949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdfa3a-eabf-42d7-b478-9139ad77d398 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:33.787096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:33.787702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:33.787979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:33.788250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:33.788877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:33.790294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df3f1-7813-4d87-9e1d-39bd13a2a2ca None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:33.796347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 399/815] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:09:33 2022] GET /identity/v3/services => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:09:36.195755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955f9-a60d-420a-b00d-26d2e06ce57a None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:36.196293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955f9-a60d-420a-b00d-26d2e06ce57a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:36.196293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5955f9-a60d-420a-b00d-26d2e06ce57a None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:36.197615 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 417/816] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:09:36.203386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:36.203845 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:36.203938 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:36.222687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:09:36.223875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:09:36.293704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 400/817] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:09:36 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:09:36.620883 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5955f9-a60d-420a-b00d-26d2e06ce57a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:36.710406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:36.721061 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5955f9-a60d-420a-b00d-26d2e06ce57a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:36.762604 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:36.763229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:36.763510 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:36.763779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] PATH_INFO: `/v3/services/compute` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:36.764380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:36.765744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:09:36.774760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:09:36.775871 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:09:36.776715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 418/818] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:09:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:09:36.781931 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:36.808113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:36.879603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16449-0a03-4b23-90a5-6078d9a16616 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:36.914039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:36.914679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:36.914961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:36.915233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:36.915857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:36.916156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:36.917518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:36.922131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 401/819] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:36.927904 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:37.026198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa1e3-2a7a-4610-8f3a-137f4426ed0d None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:37.063090 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:37.063690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:37.063964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:37.064234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:37.064856 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:09:37.065155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:37.066538 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ace0-9200-4b5f-b2bd-cab89dfeb2fa None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:37.072219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 419/820] 10.222.0.25 () {56 vars in 1112 bytes} [Fri Sep 9 11:09:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:09:37.077936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:09:37.169362 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:37.181195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb05305-1586-4079-a348-d307dce71f74 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:09:37.216517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:09:37.217237 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:09:37.217384 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:09:37.217656 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:09:37.218318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:09:37.219707 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ccacb-504a-475d-a88b-86e9ecfea4b9 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:09:37.241738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 402/821] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:09:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:09:47.068895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=90 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:09:47.242506 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=26,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:44.107692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d0c4-1343-4813-802a-fe79e4ff38ab None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:44.109246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d0c4-1343-4813-802a-fe79e4ff38ab None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:44.109246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22d0c4-1343-4813-802a-fe79e4ff38ab None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:44.121721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:44.123404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:44.123404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:44.127948 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 420/822] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:10:44 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:10:44.159961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:44.162194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:44.290939 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 403/823] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:10:44.647190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d0c4-1343-4813-802a-fe79e4ff38ab None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:44.818937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22d0c4-1343-4813-802a-fe79e4ff38ab None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:44.877220 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:44.878296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:44.878859 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:44.879310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:44.898153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:44.900547 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:10:44.927172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:44.929052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:10:44.930901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:10:44.930901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:44.930901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:10:44.930901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 421/824] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:44.938184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:45.155478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7d7e-6b94-4305-949c-47729e2d0462 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:45.210491 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:45.230535 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:45.231731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:45.232282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:45.232638 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:45.234449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:45.234907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:45.237074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274441a0-8ac2-4dce-a450-a4fd54ab91e1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:45.258875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 404/825] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:45.264817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:45.378923 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:45.470112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73209299-97ce-4fa0-b253-d969a5ecea68 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:45.530521 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:45.531151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:45.531432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:45.531723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:45.532513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:45.534003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66235e-3fc8-4b04-b146-4c30b7c4f6d7 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:45.564289 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 422/826] 10.222.0.25 () {60 vars in 1132 bytes} [Fri Sep 9 11:10:45 2022] POST /identity/v3/users => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:10:49.298616 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4676-64e0-46da-8d71-3fb8b35d0236 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:49.299303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4676-64e0-46da-8d71-3fb8b35d0236 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:49.299461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4676-64e0-46da-8d71-3fb8b35d0236 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:49.303512 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 405/827] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:49.307700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:49.308497 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:49.308705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:49.332868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:49.334104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:49.428038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 423/828] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:10:49.814901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4676-64e0-46da-8d71-3fb8b35d0236 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:49.965946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4676-64e0-46da-8d71-3fb8b35d0236 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:50.015862 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:50.016640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:50.016981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:50.017323 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:50.029028 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:10:50.035461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:50.037339 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:50.039194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 406/829] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:10:50.043566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:50.095505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:50.169172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594c9a4-46b3-443c-a966-e6b863cf2e50 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:50.231884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:50.233374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:50.233835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:50.234298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:50.235671 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:50.236197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:50.238925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:50.255826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 424/830] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:10:50.263056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:50.328689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:50.393447 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013429-ab50-45bc-8c74-fe17c737b9e0 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:50.450927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:50.452626 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:50.453118 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:50.453578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:50.474216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:50.477237 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:10:50.501275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:50.502478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:10:50.503614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:10:50.503614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:50.503614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:50.503614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 407/831] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:50.508523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:50.648001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:50.650828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130eb13-9b45-4597-90d1-4d89fb9664c9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:50.695955 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:50.696720 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:50.697097 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:50.697467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:50.698232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:50.698689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:50.700370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:50.718467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 425/832] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:50.725730 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:50.883633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:50.890955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4cb81-daec-455e-8156-d8154b42acb3 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:50.936243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:50.937094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:50.937378 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:50.937650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:50.946667 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:50.948127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:10:50.974971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:50.976046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:50.983808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 408/833] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:50.987849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:51.145758 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0176d39-2cf8-440f-8aa5-556530d0b047 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:51.196580 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:51.197237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:51.197622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:51.197982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:51.198886 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:51.199280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:51.200827 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:51.223481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 426/834] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:10:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:51.232567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:51.387449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfda80-1c79-4796-a4fb-2a702ff4c17b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:51.449248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:51.450379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:51.451076 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:51.451511 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:51.496101 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:51.553204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:51.554712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:51.678154 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 409/835] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:10:51 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:10:51.685583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:51.706812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:51.824392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00aab4-b805-49c9-a0c0-cb2533cbbce9 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:51.878265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:51.879564 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:51.880142 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:51.880720 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:51.901647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:51.904592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:10:51.934905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:51.936734 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:10:51.937642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:10:51.937642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:51.937642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:10:51.937642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 427/836] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:51.947288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:52.047001 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:52.108592 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb7a41-57da-4718-aa4a-d99003825059 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:52.161748 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:52.162370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:52.162679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:52.162950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:52.163663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:52.163971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:52.165431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:52.180074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 410/837] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:10:52.187485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:52.297581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:52.343866 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702fcd9-aabc-4396-9f61-eec0363f49e0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:52.383108 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:52.383762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:52.384039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:52.384303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:52.398143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:52.402008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:10:52.426787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:52.428620 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:10:52.430459 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 428/838] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:52.437751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:52.618283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2743229-340c-4d4a-9044-7530219115e1 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:52.643917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:52.667490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:52.668109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:52.668388 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:52.668657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:52.669355 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:52.670292 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:52.671759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ac4a-efb3-47f3-9ac9-d82d088e4501 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:52.685766 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 411/839] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:10:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:52.695367 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:52.831075 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d301a-d41d-481a-9a0b-68b4b08074a4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:52.868184 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:52.875469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:52.876198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:52.878445 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:52.878967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:52.880028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=27bab9685c4744bf987e6f857c60a989) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:52.880455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:52.882316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca5a35-5fc0-459a-8f27-b9587e68ccea None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:52.889628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 429/840] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:10:52 2022] GET /identity/v3/role_assignments?user.id=27bab9685c4744bf987e6f857c60a989&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:55.492190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b65e-bb26-4287-ba09-a0989bd2698f None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:55.493204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b65e-bb26-4287-ba09-a0989bd2698f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:55.493204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61b65e-bb26-4287-ba09-a0989bd2698f None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:55.495429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 412/841] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:10:55.502443 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:55.503276 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:55.503276 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:55.540265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:10:55.541507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:10:55.655383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 430/842] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:10:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:10:55.983734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b65e-bb26-4287-ba09-a0989bd2698f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:56.125832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61b65e-bb26-4287-ba09-a0989bd2698f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:56.180262 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:56.181112 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:56.181498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:56.181981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:56.197787 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:10:56.205726 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:56.207897 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:10:56.209743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:56.214612 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 413/843] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:10:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:56.216982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:56.372420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c8f74-cd68-4b29-9ac3-aeb14f2d118e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:56.413662 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:56.430664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:56.431508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:56.431936 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:56.432379 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:56.433428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] RBAC: Adding query filter params (name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:56.434055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:56.436898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:56.451195 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 431/844] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:10:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:56.459026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:56.525666 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:56.613850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eda2-a228-477a-970b-0fe3f3f5a617 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:56.666791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:56.667645 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:56.668069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:56.668489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:56.685389 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:56.687293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:10:56.708309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:56.710267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:10:56.718282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:10:56.718282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:56.718282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:56.718282 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 414/845] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:56.718712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:56.860215 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fecf4-7ae6-4914-b738-bcc23330e6ac None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:56.908841 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:56.909611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:56.909889 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:56.910162 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:56.911014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:56.911341 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:56.912951 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:56.932998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 432/846] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:10:56.940898 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:57.074782 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:57.089062 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c333-5d38-4a47-8d91-40a81945752a None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:57.130847 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:57.131609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:57.132017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:57.132386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:57.143818 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:57.145533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:10:57.160775 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:57.162627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:57.164500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 415/847] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:57.169705 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:57.237825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:57.326058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e694c6-7f27-4c8e-9226-c6f498e2a3b1 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:57.373905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:57.374659 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:57.375013 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:57.375352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:57.376214 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:57.376576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:57.378118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:57.401648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 433/848] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:10:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:57.410013 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:57.567395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a2d0-d31c-4b7e-a93f-c2a7c5b5cb3d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:57.605442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:57.606077 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:57.606393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:57.606706 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:57.623256 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:57.626652 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:10:57.660980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:57.662314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:10:57.663811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:10:57.663811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:10:57.663811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:57.663990 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 416/849] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:57.670127 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:57.785200 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe930b5-3319-4e21-b934-f8e94a43d616 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:57.787741 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:57.839395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:57.839897 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:57.840303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:57.840578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:57.841896 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:57.842426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:57.844088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:57.857908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 434/850] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:10:57.864245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:57.867648 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:58.013143 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87fd7-48af-4278-be28-bddbe56a2d6b None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:58.075518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:58.076519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.076977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.077450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.089810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:58.092999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:10:58.108614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:10:58.110440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:10:58.112185 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 417/851] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:10:58.117389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:58.251851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751b8f0-c3a6-4850-91bb-5e84e4d58ed3 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:58.295399 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:58.296033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.296309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.296580 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.297286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:10:58.297622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:58.299093 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cab71-885b-441a-a118-9f2a6eff7175 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:58.313737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 435/852] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:10:58.320732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:10:58.401259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:10:58.454038 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe011fd0-7281-4d38-bea6-dbede30c2e97 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:10:58.498295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:10:58.499027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:10:58.499304 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:10:58.499629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/27bab9685c4744bf987e6f857c60a989/roles/0caae7c117834b60970ae37fdc1f3874` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:10:58.519923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=27bab9685c4744bf987e6f857c60a989, role_id=0caae7c117834b60970ae37fdc1f3874)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:10:58.522199 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ce13-67cc-4622-94e7-2533a42dd5d7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:10:58.539252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 418/853] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:10:58 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/27bab9685c4744bf987e6f857c60a989/roles/0caae7c117834b60970ae37fdc1f3874 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:11:01.320592 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314759-1556-4f12-9727-917e351983b4 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:01.321988 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314759-1556-4f12-9727-917e351983b4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:01.321988 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314759-1556-4f12-9727-917e351983b4 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:01.324135 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 436/854] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:01.331533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:01.332554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:01.332724 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:01.366532 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:01.368473 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:01.490436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 419/855] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:01 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:01.864535 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314759-1556-4f12-9727-917e351983b4 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:01.909251 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:02.044621 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314759-1556-4f12-9727-917e351983b4 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:02.094287 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:02.095072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:02.095360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:02.095623 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:02.115913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:11:02.120880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:02.123469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:02.125584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 437/856] 10.222.0.25 () {56 vars in 1102 bytes} [Fri Sep 9 11:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:02.133373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:02.207779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:02.283889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c96c3-18a7-4cf6-aa5a-b89a04f5dffb None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:02.342634 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:02.343737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:02.343737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:02.343737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:02.344520 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:02.344963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:02.346866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:02.361617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 420/857] 10.222.0.25 () {56 vars in 1103 bytes} [Fri Sep 9 11:11:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:02.369828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:02.511062 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:02.540502 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7af0-8dbc-4c6d-87a4-4de0b6e63013 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:02.600240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:02.601244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:02.601733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:02.602206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:02.619593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:02.624713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:02.645895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:02.647949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:02.649098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:02.649098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:02.649098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:02.649098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 438/858] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:02.657731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:02.811393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148adf3-2ea2-44ff-a5f7-ca669ef71db8 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:02.816426 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:02.870466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:02.871096 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:02.871901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:02.872180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:02.872842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:02.873146 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:02.874590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:02.889900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 421/859] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:11:02.896767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:03.045739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e537d-9936-45d1-9b4f-98245efb709c None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:03.100709 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:03.101543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:03.101895 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:03.102206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:03.106376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:03.113818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:03.115430 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:11:03.128311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:03.130314 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:03.131835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 439/860] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:03.135867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:03.287805 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffdd0b5-a662-4d46-b3d0-6995972e0ee5 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:03.336120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:03.336965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:03.337464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:03.337942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:03.339057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:03.339526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:03.341277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:03.374272 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 422/861] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:11:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:03.380652 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:03.546269 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b116b1-b258-4276-89f0-72d788c9605b None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:03.597236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:03.597919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:03.598243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:03.598558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:03.686130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:03.698855 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:03.701643 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:03.860515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 440/862] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:11:03 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:11:03.869236 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:03.903575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:04.036742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c0bc8-319e-4ea8-8702-13524df4f7ee None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:04.104921 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:04.106294 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:04.106751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:04.107110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:04.120759 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:04.122136 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:04.144992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:04.147252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:04.148459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:04.148459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:04.148459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:04.151555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 423/863] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:04.154234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:04.297263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:04.306308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514542f-bb19-42db-9c21-1dea6e704443 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:04.358419 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:04.359270 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:04.359673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:04.360055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:04.360904 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:04.361316 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:04.363079 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:04.386584 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 441/864] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:11:04.389410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:04.530584 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:04.571463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6dcb9-3491-4719-a18e-9cc84f9c511c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:04.626113 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:04.627244 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:04.627664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:04.628036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:04.637629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:04.639067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:11:04.652454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:04.654615 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:04.655498 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 424/865] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:04.663933 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:04.788474 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77700-a29f-47b3-acb5-5186c7f2c035 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:04.832672 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:04.833450 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:04.833838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:04.834222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:04.835181 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:04.835647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:04.837338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d7b0-741e-42bd-acf5-e2239608f831 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:04.855176 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 442/866] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:04.865515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:05.042703 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bee6b7-0329-4a08-b64a-7cab74b5e03f None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:05.092046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:05.092821 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:05.093194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:05.093394 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:05.094205 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] RBAC: Adding query filter params (role.id=0caae7c117834b60970ae37fdc1f3874, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=27bab9685c4744bf987e6f857c60a989) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:05.094562 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:05.096020 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef35218-c099-4831-bf64-bc8d202b0820 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:05.098248 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:05.103896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 425/867] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:11:04 2022] GET /identity/v3/role_assignments?user.id=27bab9685c4744bf987e6f857c60a989&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=0caae7c117834b60970ae37fdc1f3874 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:07.868188 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650f3e-70ea-448f-a39c-fdbd91e12630 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:07.868874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650f3e-70ea-448f-a39c-fdbd91e12630 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:07.869025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650f3e-70ea-448f-a39c-fdbd91e12630 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:07.871498 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 443/868] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:07.878822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:07.879664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:07.879664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:07.907026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:07.908814 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:08.009917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 426/869] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:08.365818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650f3e-70ea-448f-a39c-fdbd91e12630 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:08.388379 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:08.508336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650f3e-70ea-448f-a39c-fdbd91e12630 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:08.567919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:08.568916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:08.569400 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:08.569865 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:08.585860 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:11:08.591353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:08.593730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:08.595508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 444/870] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:11:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:08.599659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:08.743129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34978734-a1fd-4e7f-8865-8f1a2fbe8d33 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:08.795393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:08.810808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:08.812119 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:08.812613 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:08.813091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:08.814328 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:08.814901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:08.817223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:08.839770 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 427/871] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:08.842232 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:08.972675 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:09.017973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a1bb7-78d8-4d5c-a3c7-c78cb8b7bba5 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:09.084513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:09.085568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:09.086105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:09.086565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:09.105724 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:09.108864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:09.137018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:09.138178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:09.139187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:09.139187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:09.139187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:09.139187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 445/872] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:11:09.147961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:09.310964 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28698667-7fb2-4b44-8e93-987bd0b62be6 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:09.371624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:09.372250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:09.372546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:09.372808 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:09.373440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:09.373795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:09.375203 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:09.396163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 428/873] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:09.404795 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:09.579789 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d8cae-a4a9-4b94-aebd-68354f8caae2 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:09.629366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:09.640289 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:09.640967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:09.641244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:09.641612 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:09.651174 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:09.652903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:11:09.666489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:09.669102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:09.671122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 446/874] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:11:09.676054 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:09.777820 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:09.877927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65b75-c694-4b59-a890-7c2ae423d3a7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:09.942329 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:09.943286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:09.944011 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:09.944486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:09.945552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:09.945909 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:09.947538 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:09.977120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 429/875] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:11:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:09.985407 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:10.135352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb23c0c-2cac-428b-8295-6a37082a172f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:10.183630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:10.184367 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:10.184774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:10.185226 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:10.279224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:10.296720 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:10.298992 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:10.455581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 447/876] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:11:09 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 11:11:10.465351 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:10.639553 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f06b8-bf62-4d9b-8a29-cb0b4fdbf2bd None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:10.657137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:10.700729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:10.701717 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:10.702219 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:10.702749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:10.721699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:10.724394 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:10.752691 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:10.754010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:10.755218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:10.755218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:10.755218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:10.755218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 430/877] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:10.762471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:10.862196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:10.875947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aca40-b289-4451-8dd7-aeb5578a5276 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:10.914072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:10.914712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:10.914990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:10.915258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:10.915897 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:10.916197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:10.917578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:10.930573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 448/878] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:10.940180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:11.074786 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9eed1-9eb5-4c7b-953f-52086851355d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:11.113642 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:11.114277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:11.114605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:11.114874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:11.122554 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:11.124000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:11:11.136838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:11.138659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:11.140630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 431/879] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:11:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:11.147153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:11.256690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8d34-0b0e-44be-a1a2-3ebb3fe6c3c0 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:11.293731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:11.294335 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:11.294644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:11.294916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:11.295610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:11.295918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:11.297337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220478ac-5511-4b1a-ac9e-2cbcd835b276 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:11.310259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 449/880] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:11.316664 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:11.341492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:11.426505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddf374-c2ec-46d7-b068-efec3fe86317 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:11.465970 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:11.466736 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:11.466867 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:11.467138 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:11.467878 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=27bab9685c4744bf987e6f857c60a989) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:11.468198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:11.469637 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ea2e-f54c-48d4-8807-3a03891540fc None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:11.475793 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 432/881] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:11:11 2022] GET /identity/v3/role_assignments?user.id=27bab9685c4744bf987e6f857c60a989&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=812192d969e9436d9845f219dd311628 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:11:14.029356 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d21d-d5d1-4562-9838-84781b950083 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:14.029940 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d21d-d5d1-4562-9838-84781b950083 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:14.030455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517d21d-d5d1-4562-9838-84781b950083 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:14.032434 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 450/882] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:14.038307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:14.038884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:14.038884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:14.058752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:14.060021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:14.155388 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 433/883] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:14.482829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517d21d-d5d1-4562-9838-84781b950083 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:14.493899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:14.597913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517d21d-d5d1-4562-9838-84781b950083 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:14.637486 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:14.638149 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:14.638465 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:14.638742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:14.650825 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:11:14.655890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:14.657110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:14.658004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 451/884] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:14.663489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:14.681663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:14.778158 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a79ce-a7e8-4fa0-b64c-c941cb103c6e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:14.812137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:14.812746 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:14.813023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:14.813293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:14.813951 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:14.814250 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:14.815646 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:14.824403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 434/885] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:14.830138 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:14.901190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:14.937519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c663bf-f317-4660-870d-eddb45032493 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:14.974655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:14.975322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:14.975693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:14.976115 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:14.989804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:14.991288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:15.007793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:15.009495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:15.010655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:15.010655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:15.010655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:15.010655 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 452/886] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:15.016259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.108021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:15.136684 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112bd4-0df4-49f7-9931-bef2ed9027db None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:15.171369 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:15.171977 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.172259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.172533 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.173433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:15.173733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:15.175129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.187543 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 435/887] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:15.193525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.302201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53616e1-7b16-44ff-8a83-941ad9c205db None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:15.322027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:15.336337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:15.336975 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.337255 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.337530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.345901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:15.347384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:11:15.359428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:15.360576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:15.361641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 453/888] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:15.367068 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.482412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c82c-56ea-4929-86be-c4f45b73fcee None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:15.518753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:15.519358 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.519633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.519903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.520627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:15.520927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:15.522372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.525056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:15.543573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 436/889] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:15.550499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.658125 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37be46c-c736-4216-9790-0d33e8686607 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:15.695285 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:15.695945 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.696219 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.696484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.708366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:15.709796 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:15.725306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:15.727065 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:15.728229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:15.728229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:15.728229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:15.728229 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 454/890] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:15.732370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.839367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ceb41-ab4e-4f90-b23f-07e2a7862ef2 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:15.876465 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:15.877124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:15.877441 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:15.877754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:15.878483 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:15.878831 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:15.880257 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:15.893098 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 437/891] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:11:15.900452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:15.935991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:16.012068 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602eee5-7d27-4560-a07b-22fe2b955d09 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:16.048619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:16.049267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:16.049543 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:16.049812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:16.058286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:16.059771 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:11:16.071748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:16.073382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:16.074371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 455/892] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:16.081809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:16.141266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:16.188645 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351168-77fb-42b2-90e8-21880cfcfa84 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:16.225329 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:16.225955 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:16.226234 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:16.226537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:16.227245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:16.227551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:16.229057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8b19a-38ca-4c78-b834-383b56067a2a None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:16.242219 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 438/893] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:16.251812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:16.351680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:16.361899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362e897-b891-49f9-be0a-2ba5737f34a4 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:16.396209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:16.396868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:16.397148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:16.397426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] PATH_INFO: `/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/27bab9685c4744bf987e6f857c60a989/roles/812192d969e9436d9845f219dd311628` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:16.399375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=80931a631fe5403d82bc5fe8f41af018, user_id=27bab9685c4744bf987e6f857c60a989, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:16.400866 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a66c5-db44-4829-990e-55ff377266e6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:16.416033 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 456/894] 10.222.0.25 () {58 vars in 1439 bytes} [Fri Sep 9 11:11:16 2022] PUT /identity/v3/projects/80931a631fe5403d82bc5fe8f41af018/users/27bab9685c4744bf987e6f857c60a989/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:11:18.857753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bdf3f-3eaa-47e7-83cc-198f4b0d64ff None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:18.858373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bdf3f-3eaa-47e7-83cc-198f4b0d64ff None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:18.858373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bdf3f-3eaa-47e7-83cc-198f4b0d64ff None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:18.859683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 439/895] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:18.865489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:18.866031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:18.866031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:18.884511 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:18.886290 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:18.968248 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 457/896] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:11:19.299027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bdf3f-3eaa-47e7-83cc-198f4b0d64ff None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:19.488413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bdf3f-3eaa-47e7-83cc-198f4b0d64ff None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:19.507206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:19.532069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:19.532822 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:19.533155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:19.533470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:19.546044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 11:11:19.551399 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:19.553102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:19.555152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 440/897] 10.222.0.25 () {56 vars in 1096 bytes} [Fri Sep 9 11:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:19.560838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:19.654271 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:19.674291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f10cf-f532-4159-920a-38276bc05779 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:19.712039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:19.712686 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:19.713582 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:19.713888 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:19.714637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:19.714976 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:19.716373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:19.725225 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 458/898] 10.222.0.25 () {56 vars in 1099 bytes} [Fri Sep 9 11:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:19.734742 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:19.891515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cd1e-e0b7-480d-9ab5-5c0d7e9136e9 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:19.938057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:19.939148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:19.939916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:19.940361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:19.959460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:19.962144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:19.995678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:19.996827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:19.997729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:19.997729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:19.997729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:19.997729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 441/899] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:20.004631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:20.162912 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7584682-14a0-413b-9b26-3be81c1a208f None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:20.200728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:20.201355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:20.201633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:20.201901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:20.202576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:20.202887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:20.204252 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:20.216898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 459/900] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:20.222940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:20.254659 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:20.385620 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127c216-092a-4b54-bfc7-c74d5d6bcc1c None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:20.445317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:20.446318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:20.446840 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:20.447841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:20.461376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:20.464586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 11:11:20.485819 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:20.487577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:20.489390 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 442/901] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:20.495847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:20.499937 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:20.612806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff6c50-4553-45d5-932f-c0aa76f46065 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:20.655866 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:20.656475 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:20.656753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:20.657022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:20.657751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:20.658056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:20.659513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:20.678327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 460/902] 10.222.0.25 () {56 vars in 1143 bytes} [Fri Sep 9 11:11:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:20.687620 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:20.777629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:20.795004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c705-ac54-4b81-8a21-55877ca28679 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:20.829764 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:20.830400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:20.830685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:20.830954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:20.904539 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:20.905992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.000215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:21.019485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 443/903] 10.222.0.25 () {58 vars in 1282 bytes} [Fri Sep 9 11:11:20 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 11:11:21.025624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:21.088638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:21.129257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92459-836d-431b-844f-996cc5bda1a6 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:21.186274 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:21.187377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:21.187863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:21.188337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:21.205966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:21.208618 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 11:11:21.235222 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:21.236429 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 11:11:21.237561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 11:11:21.237561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 11:11:21.237561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:21.237561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 461/904] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:21.243215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:21.352489 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e59eb8-5347-41a3-b4fd-c08509cae1a7 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:21.395166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:21.395776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:21.396055 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:21.396325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:21.396968 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:21.397270 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:21.398671 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.411669 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 444/905] 10.222.0.25 () {56 vars in 1109 bytes} [Fri Sep 9 11:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:21.417715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:21.523583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7dcb4-b7d3-477c-9bfc-8f2223a643fd None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:21.538797 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:21.560092 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:21.560727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:21.561004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:21.561275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:21.568367 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:21.569806 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 11:11:21.581293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:21.583027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: ERROR keystone.server.flask.application Sep 09 11:11:21.584206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 462/906] 10.222.0.25 () {56 vars in 1111 bytes} [Fri Sep 9 11:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:11:21.589115 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:21.640061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:21.700175 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8750a94-7745-4c95-9e04-07b892bc63b4 None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:21.736222 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:21.736996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:21.737329 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:21.737650 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:21.738428 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:21.738782 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:21.740259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bd3be-ec36-462d-a12d-6a246a6dfbec None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.752933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 445/907] 10.222.0.25 () {56 vars in 1148 bytes} [Fri Sep 9 11:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:21.759932 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:21.867907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748223d-9f3b-4fbb-9b76-7a7b41f0a813 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:21.903911 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:21.904865 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:21.905315 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:21.905776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:21.907146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] RBAC: Adding query filter params (role.id=812192d969e9436d9845f219dd311628, scope.project.id=80931a631fe5403d82bc5fe8f41af018, user.id=27bab9685c4744bf987e6f857c60a989) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:21.907677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:21.910377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6a4c3-3913-4323-b085-a723b65caac1 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:21.921767 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 463/908] 10.222.0.25 () {56 vars in 1374 bytes} [Fri Sep 9 11:11:21 2022] GET /identity/v3/role_assignments?user.id=27bab9685c4744bf987e6f857c60a989&scope.project.id=80931a631fe5403d82bc5fe8f41af018&role.id=812192d969e9436d9845f219dd311628 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:11:24.411739 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d294-417f-431e-bc2f-3dffe3f9cdd0 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:24.412277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d294-417f-431e-bc2f-3dffe3f9cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:24.412277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3d294-417f-431e-bc2f-3dffe3f9cdd0 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:24.413594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 446/909] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:24.419787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:24.420300 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:24.420392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:24.439307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:24.440509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:24.471447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:24.511392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 464/910] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 11:11:24.835044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3d294-417f-431e-bc2f-3dffe3f9cdd0 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:24.957721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3d294-417f-431e-bc2f-3dffe3f9cdd0 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:24.967088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:25.000996 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:25.001636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:25.001919 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:25.002187 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:25.002886 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:25.004306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:25.013413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:25.014700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:25.015555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 447/911] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 9 11:11:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 11:11:25.020594 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:25.121132 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e8a5a-9d55-48b5-ae50-cfe5cb953072 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:25.155485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:25.156085 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:25.156362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:25.156631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:25.157260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:25.157558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:25.158942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d784f8-c3a3-43aa-b054-4fba1fb2826c None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:25.163733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 465/912] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 9 11:11:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:25.170366 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:25.277944 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56976-8397-442b-bcba-8475295ab88d None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:25.312774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:25.313379 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:25.313663 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:25.313934 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] PATH_INFO: `/v3/services` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:25.314601 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] RBAC: Adding query filter params (type=placement) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:25.314903 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:25.316290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946974d6-e245-4196-859a-a176bc7bdf1d None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:25.321028 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 448/913] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 9 11:11:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:27.775739 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0346ac-1f6d-47f1-9bb7-14e20c2de1f8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:27.776364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0346ac-1f6d-47f1-9bb7-14e20c2de1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:27.776364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0346ac-1f6d-47f1-9bb7-14e20c2de1f8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:27.777605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 466/914] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:27.784780 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0ff56-dabb-43e7-af8b-e0ba5e2ba212 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:27.785340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0ff56-dabb-43e7-af8b-e0ba5e2ba212 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:27.785802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0ff56-dabb-43e7-af8b-e0ba5e2ba212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:27.817527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c9d0ff56-dabb-43e7-af8b-e0ba5e2ba212 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:27.819563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c9d0ff56-dabb-43e7-af8b-e0ba5e2ba212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:27.869076 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:27.919103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 449/915] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:28.239422 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0346ac-1f6d-47f1-9bb7-14e20c2de1f8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:28.274917 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:28.359417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0346ac-1f6d-47f1-9bb7-14e20c2de1f8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:28.401540 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:28.402154 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:28.402463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:28.402737 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:28.403406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:28.404807 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734179c-31f6-40d4-8d05-747432457447 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:28.423645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 467/916] 10.222.0.25 () {60 vars in 1141 bytes} [Fri Sep 9 11:11:28 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:11:30.972284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae3d-16b7-4c86-95a1-8d79d606d8ff None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:30.972849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae3d-16b7-4c86-95a1-8d79d606d8ff None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:30.972849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbae3d-16b7-4c86-95a1-8d79d606d8ff None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:30.974143 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 450/917] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:30.979967 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:30.980393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:30.980509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:30.999948 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:31.001155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:31.081953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 468/918] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:30 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:31.407033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbae3d-16b7-4c86-95a1-8d79d606d8ff None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:31.515763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbae3d-16b7-4c86-95a1-8d79d606d8ff None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:31.554293 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:31.554949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.555812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.556081 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] PATH_INFO: `/v3/services/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.556658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:31.558017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:31.566732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:31.567932 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:31.568936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:31.570578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 451/919] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 9 11:11:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:11:31.573910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:31.591965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:31.679642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe37d9c-52b6-4b1c-8baa-9c0a0ce0bbe1 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:31.714107 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:31.714748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.715029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.715296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.715928 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:31.716227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:31.717585 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:31.722838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 469/920] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 9 11:11:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:31.730487 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:31.760070 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:31.835620 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75741f-139c-4677-a149-12fab638ebbb None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:31.871253 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:31.871851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:31.872125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:31.872391 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:31.873082 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] RBAC: Adding query filter params (interface=public, service_id=daf6810a9f314edd8b4b1e5c0dfca2a7, region_id=RegionOne) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:31.873383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:31.874767 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34a109-3aed-4033-b761-a19022469afa None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:31.879906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 452/921] 10.222.0.25 () {56 vars in 1251 bytes} [Fri Sep 9 11:11:31 2022] GET /identity/v3/endpoints?service_id=daf6810a9f314edd8b4b1e5c0dfca2a7&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:31.885941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:31.974965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:31.995306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f99f-deb0-430c-bf4d-0cf8aef23528 None admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:32.030327 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:32.030972 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:32.031249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:32.031515 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:32.032117 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:32.033495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57736d1-d854-40e3-aae4-f0e5f36f88c9 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:32.041016 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 470/922] 10.222.0.25 () {56 vars in 1087 bytes} [Fri Sep 9 11:11:31 2022] GET /identity/v3/services => generated 1962 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:11:34.505566 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ca62-3109-4023-8398-576695c2334d None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:34.506129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ca62-3109-4023-8398-576695c2334d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:34.506129 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ca62-3109-4023-8398-576695c2334d None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:34.507503 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 453/923] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:11:34.517137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:34.517689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:34.518027 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:34.539589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:11:34.540774 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:11:34.611082 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 471/924] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:11:34 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 11:11:34.934400 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ca62-3109-4023-8398-576695c2334d None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:35.046651 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:35.062551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ca62-3109-4023-8398-576695c2334d None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:35.123907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:35.124990 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:35.125474 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:35.125954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:35.127043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:35.129559 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 11:11:35.147060 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 11:11:35.148454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application with Lock( Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self._enter() Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application return self.creator() Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application created_value = creator( Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 11:11:35.149469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: ERROR keystone.server.flask.application Sep 09 11:11:35.150519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 454/925] 10.222.0.25 () {56 vars in 1117 bytes} [Fri Sep 9 11:11:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 11:11:35.156690 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:35.252589 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:35.278331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06bb1-a5d6-42cf-afe7-36da527cb71a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:35.315116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:35.315740 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:35.316020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:35.316291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] PATH_INFO: `/v3/services` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:35.316939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:11:35.317242 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:35.318688 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d574f83-49bb-4242-be23-1b66128ada88 None admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:35.324964 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 472/926] 10.222.0.25 () {56 vars in 1116 bytes} [Fri Sep 9 11:11:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:11:35.331195 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:11:35.445624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35828f9e-40e8-42b9-a927-d2c4f93c044e None admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:11:35.481063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:11:35.481679 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:11:35.481954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:11:35.482221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:11:35.482948 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:11:35.484334 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815ecf-a5e5-426a-953c-1e8cb93b7b45 None admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:11:35.511412 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 455/927] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:11:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:11:45.321848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=30 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:11:45.503546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:42.754260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635e36-4030-45c1-b6ff-e6dde4c809b2 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:42.754835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635e36-4030-45c1-b6ff-e6dde4c809b2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:42.754835 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635e36-4030-45c1-b6ff-e6dde4c809b2 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:42.756943 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 473/928] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:42.763754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c232-6146-460e-97de-844ea854f321 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:42.764317 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c232-6146-460e-97de-844ea854f321 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:42.764687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c232-6146-460e-97de-844ea854f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:42.804301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-3f26c232-6146-460e-97de-844ea854f321 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:42.805683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-3f26c232-6146-460e-97de-844ea854f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:42.901183 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 456/929] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:43.262196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7709fa-763f-4d19-8a47-e2e29245734f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:43.262602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7709fa-763f-4d19-8a47-e2e29245734f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:43.262949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7709fa-763f-4d19-8a47-e2e29245734f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:43.264357 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 474/930] 10.222.0.25 () {54 vars in 965 bytes} [Fri Sep 9 11:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:43.271397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfeb2-aa14-435d-a023-0e0edc4e9f59 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:43.271684 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfeb2-aa14-435d-a023-0e0edc4e9f59 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:43.271999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cfeb2-aa14-435d-a023-0e0edc4e9f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:43.330474 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c37cfeb2-aa14-435d-a023-0e0edc4e9f59 None None] MFA Rules not processed for user `35c6844418444e628e65ff78e25f5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:43.331672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c37cfeb2-aa14-435d-a023-0e0edc4e9f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:43.402098 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 457/931] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Sep 9 11:12:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:43.411824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7709fa-763f-4d19-8a47-e2e29245734f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:43.423956 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7709fa-763f-4d19-8a47-e2e29245734f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:43.428310 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:43.428933 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:43.429215 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:43.429481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:43.449700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:43.452514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492a129-62f4-4f43-abd8-d660c0634ec8 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:43.470721 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 475/932] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:46.251114 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57989b12-7d46-4f57-b3c4-72f283db9006 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.251870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57989b12-7d46-4f57-b3c4-72f283db9006 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.251870 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57989b12-7d46-4f57-b3c4-72f283db9006 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.253330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 458/933] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:46.259576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47933-76b6-404e-8de5-2c5010750ece None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.260371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47933-76b6-404e-8de5-2c5010750ece None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.260371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b47933-76b6-404e-8de5-2c5010750ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.291388 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b8b47933-76b6-404e-8de5-2c5010750ece None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:46.292605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b8b47933-76b6-404e-8de5-2c5010750ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:46.301185 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 476/934] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:46.636416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57989b12-7d46-4f57-b3c4-72f283db9006 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:46.651524 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57989b12-7d46-4f57-b3c4-72f283db9006 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:46.655196 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:46.655807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:46.656078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:46.656346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:46.669995 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:46.670962 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0d97a-1748-482b-8f56-49ebc6a00e01 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:46.685433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 459/935] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:12:49.501028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19aed-eb37-4e0b-98ec-af63a5560bdc None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.501546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19aed-eb37-4e0b-98ec-af63a5560bdc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.501546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19aed-eb37-4e0b-98ec-af63a5560bdc None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.502923 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 477/936] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:49.508624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6d5d-4b01-4985-a5f3-c63301521fea None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.509043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6d5d-4b01-4985-a5f3-c63301521fea None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.509286 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6d5d-4b01-4985-a5f3-c63301521fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.547175 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-4dfc6d5d-4b01-4985-a5f3-c63301521fea None None] MFA Rules not processed for user `45c7d26095714830a97140f749aab33f`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:49.548373 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-4dfc6d5d-4b01-4985-a5f3-c63301521fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:49.589499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:12:49.617097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 460/937] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:49 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:49.983845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537ee4-556b-4b63-ab41-5930bc8eddc0 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.983845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537ee4-556b-4b63-ab41-5930bc8eddc0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.983845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05537ee4-556b-4b63-ab41-5930bc8eddc0 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:49.983845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 478/938] 10.222.0.25 () {54 vars in 965 bytes} [Fri Sep 9 11:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:49.988071 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d640de-b563-447c-8146-54b36e657759 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:49.988356 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d640de-b563-447c-8146-54b36e657759 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:49.988636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d640de-b563-447c-8146-54b36e657759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:50.018216 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-13d640de-b563-447c-8146-54b36e657759 None None] MFA Rules not processed for user `35c6844418444e628e65ff78e25f5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:50.019539 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-13d640de-b563-447c-8146-54b36e657759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:50.026849 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 461/939] 10.222.0.25 () {58 vars in 1062 bytes} [Fri Sep 9 11:12:49 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:12:50.036355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537ee4-556b-4b63-ab41-5930bc8eddc0 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:50.048536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05537ee4-556b-4b63-ab41-5930bc8eddc0 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:50.052364 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:50.055383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:50.055383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:50.055383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:50.064615 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:50.066134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3562b-365c-43d1-9c84-42470d053476 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:50.076941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 479/940] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:50 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:53.343021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa001f-0bfb-4f94-a9d2-dc165db7b785 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:53.343557 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa001f-0bfb-4f94-a9d2-dc165db7b785 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:53.343557 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa001f-0bfb-4f94-a9d2-dc165db7b785 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:53.344916 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 462/941] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:53.350557 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba725-6bfb-401b-943f-543b35be347f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:53.350989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba725-6bfb-401b-943f-543b35be347f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:53.351137 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ba725-6bfb-401b-943f-543b35be347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:53.370908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b21ba725-6bfb-401b-943f-543b35be347f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:53.372121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b21ba725-6bfb-401b-943f-543b35be347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:53.445664 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 480/942] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:53 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:53.784440 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa001f-0bfb-4f94-a9d2-dc165db7b785 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:53.795658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa001f-0bfb-4f94-a9d2-dc165db7b785 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:53.799043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:53.799625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:53.799900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:53.800164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:53.809410 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:53.810827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde3527-71a6-4403-ba29-17a275fa8729 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:53.820517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 463/943] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:53 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:56.900644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c75b5-2788-4306-b77d-7446190c2cef None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:56.901208 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c75b5-2788-4306-b77d-7446190c2cef None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:56.901208 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c75b5-2788-4306-b77d-7446190c2cef None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:56.902556 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 481/944] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:56.907773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e56e-bac7-4092-b698-9fd1320ecbf4 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:56.908194 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e56e-bac7-4092-b698-9fd1320ecbf4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:56.908311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e56e-bac7-4092-b698-9fd1320ecbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:56.927696 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e094e56e-bac7-4092-b698-9fd1320ecbf4 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:56.928922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e094e56e-bac7-4092-b698-9fd1320ecbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:56.937485 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 464/945] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:12:57.279143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c75b5-2788-4306-b77d-7446190c2cef None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:12:57.290263 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c75b5-2788-4306-b77d-7446190c2cef None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:12:57.293792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:12:57.294412 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:57.294691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:57.294961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:57.305363 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:12:57.306822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97ff11-c5e5-4131-a366-6117636e0e6f service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:12:57.316991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 482/946] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:12:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:12:59.829166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748dca2-ca0e-4221-b13b-9e02eb885ca7 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:59.829741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748dca2-ca0e-4221-b13b-9e02eb885ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:59.829741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748dca2-ca0e-4221-b13b-9e02eb885ca7 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:59.831414 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 465/947] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:12:59.837305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e216e-f17a-4103-8816-c9a6f6ee7752 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:12:59.838104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e216e-f17a-4103-8816-c9a6f6ee7752 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:12:59.838104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e216e-f17a-4103-8816-c9a6f6ee7752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:12:59.858006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-260e216e-f17a-4103-8816-c9a6f6ee7752 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:12:59.859249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-260e216e-f17a-4103-8816-c9a6f6ee7752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:12:59.867359 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 483/948] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:12:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:13:00.201885 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748dca2-ca0e-4221-b13b-9e02eb885ca7 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:00.212807 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748dca2-ca0e-4221-b13b-9e02eb885ca7 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:00.216913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:00.217596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:00.217875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:00.218146 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:00.228101 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:00.229546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5135de-6be1-4b68-bd33-ae58ed51d6b8 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:00.239711 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 466/949] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:13:02.732727 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa8f7-122f-40be-91ba-e674aa048ae3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:02.733270 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa8f7-122f-40be-91ba-e674aa048ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:02.733270 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa8f7-122f-40be-91ba-e674aa048ae3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:02.734638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 484/950] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:02.744363 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2bea-d1d0-45dc-a739-61cfba667817 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:02.744887 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2bea-d1d0-45dc-a739-61cfba667817 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:02.744965 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2bea-d1d0-45dc-a739-61cfba667817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:02.768769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-eccc2bea-d1d0-45dc-a739-61cfba667817 None None] MFA Rules not processed for user `45c7d26095714830a97140f749aab33f`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:02.769974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-eccc2bea-d1d0-45dc-a739-61cfba667817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:02.778733 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 467/951] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:02 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:03.120551 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caa8f7-122f-40be-91ba-e674aa048ae3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:03.132421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caa8f7-122f-40be-91ba-e674aa048ae3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:03.138046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:03.138673 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:03.138952 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:03.139224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:03.148659 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:03.150084 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffdbf0-01ae-4d79-bbf3-5c7b20eedc6c service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:03.160243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 485/952] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:03 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:05.882130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63436a3-b7f9-4bfc-865d-d0cec6895447 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:05.882686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63436a3-b7f9-4bfc-865d-d0cec6895447 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:05.882806 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63436a3-b7f9-4bfc-865d-d0cec6895447 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:05.884593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 468/953] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:05.890031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6ba68-a10b-4b08-942d-10e57b5bf7ee None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:05.890486 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6ba68-a10b-4b08-942d-10e57b5bf7ee None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:05.890776 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6ba68-a10b-4b08-942d-10e57b5bf7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:05.898072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=62 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:05.911262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ccb6ba68-a10b-4b08-942d-10e57b5bf7ee None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:05.912456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ccb6ba68-a10b-4b08-942d-10e57b5bf7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:05.920189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 486/954] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:06.261444 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63436a3-b7f9-4bfc-865d-d0cec6895447 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:06.273752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63436a3-b7f9-4bfc-865d-d0cec6895447 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:06.277260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:06.277857 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:06.278137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:06.278558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:06.287868 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:06.289288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371410ec-ac41-4b8e-ab0b-53859a1fbb34 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:06.299209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 469/955] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:08.777240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9ab0-6f2d-450b-b911-4fc8cee91352 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:08.777793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9ab0-6f2d-450b-b911-4fc8cee91352 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:08.777793 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9ab0-6f2d-450b-b911-4fc8cee91352 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:08.779120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 487/956] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:08.784163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e60bc-6091-4787-bad7-773e15790b28 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:08.784556 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e60bc-6091-4787-bad7-773e15790b28 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:08.784713 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e60bc-6091-4787-bad7-773e15790b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:08.803552 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-069e60bc-6091-4787-bad7-773e15790b28 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:08.804737 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-069e60bc-6091-4787-bad7-773e15790b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:08.812517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 470/957] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:09.148879 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9ab0-6f2d-450b-b911-4fc8cee91352 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:09.160206 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9ab0-6f2d-450b-b911-4fc8cee91352 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:09.163692 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:09.164334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:09.164557 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:09.164822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:09.174550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:09.175958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547a0b-98f9-43ec-8f94-01766b9d875f service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:09.185230 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 488/958] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:12.016277 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd01a-8897-4b84-a9a1-ba1733c53279 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:12.016812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd01a-8897-4b84-a9a1-ba1733c53279 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:12.016812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd01a-8897-4b84-a9a1-ba1733c53279 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:12.018114 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 471/959] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:12.023187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748410c-b9c5-4d66-9b12-d9fc709fbe7b None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:12.023565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748410c-b9c5-4d66-9b12-d9fc709fbe7b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:12.023794 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748410c-b9c5-4d66-9b12-d9fc709fbe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:12.045211 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b748410c-b9c5-4d66-9b12-d9fc709fbe7b None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:12.046456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b748410c-b9c5-4d66-9b12-d9fc709fbe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:12.054284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 489/960] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:12 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:12.386078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd01a-8897-4b84-a9a1-ba1733c53279 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:12.396614 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd01a-8897-4b84-a9a1-ba1733c53279 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:12.400417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:12.400997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:12.401270 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:12.401537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:12.410655 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:12.412063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c8d38-58c3-4dd0-8db7-a3910985533e service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:12.421876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 472/961] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:12 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:13:16.890298 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9398-9b9a-40d7-a2c5-a2c81a7e6c7e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:16.890938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9398-9b9a-40d7-a2c5-a2c81a7e6c7e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:16.890938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f9398-9b9a-40d7-a2c5-a2c81a7e6c7e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:16.892187 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 490/962] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:16.897372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725bdb-a9c8-4c84-85f8-301dc2143b27 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:16.897828 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725bdb-a9c8-4c84-85f8-301dc2143b27 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:16.898028 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2725bdb-a9c8-4c84-85f8-301dc2143b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:16.920508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-b2725bdb-a9c8-4c84-85f8-301dc2143b27 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:16.921706 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b2725bdb-a9c8-4c84-85f8-301dc2143b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:16.929772 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 473/963] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:13:17.267413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f9398-9b9a-40d7-a2c5-a2c81a7e6c7e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:17.279467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f9398-9b9a-40d7-a2c5-a2c81a7e6c7e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:17.283392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:17.284003 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:17.284278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:17.284548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:17.294764 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:17.297341 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59678327-e61c-4aa0-9d5e-31cd4006f438 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:17.313386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 491/964] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:20.390290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fc27-35d5-4dea-a5fa-4b32b5d13616 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:20.390874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fc27-35d5-4dea-a5fa-4b32b5d13616 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:20.390874 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fc27-35d5-4dea-a5fa-4b32b5d13616 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:20.392417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 474/965] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:20.397799 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179d5c-88f5-45e0-8013-caa56bc97407 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:20.398318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179d5c-88f5-45e0-8013-caa56bc97407 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:20.398438 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179d5c-88f5-45e0-8013-caa56bc97407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:20.418179 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-b3179d5c-88f5-45e0-8013-caa56bc97407 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:20.419424 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-b3179d5c-88f5-45e0-8013-caa56bc97407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:20.427446 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 492/966] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:20 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:20.773917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67fc27-35d5-4dea-a5fa-4b32b5d13616 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:20.779314 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=51 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:20.785361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67fc27-35d5-4dea-a5fa-4b32b5d13616 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:20.788869 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:20.789463 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:20.789738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:20.790008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:20.799747 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:20.801220 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c35ff-39bb-4edc-946b-a6305b344862 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:20.811569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 475/967] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:20 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:25.254304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdd5-2374-4524-8713-455fbe66f8ac None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:25.255165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdd5-2374-4524-8713-455fbe66f8ac None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:25.255165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8bdd5-2374-4524-8713-455fbe66f8ac None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:25.256481 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 493/968] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:25.262104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5c95e-67af-45f6-8b00-12ec28d2c19f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:25.262603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5c95e-67af-45f6-8b00-12ec28d2c19f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:25.262709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5c95e-67af-45f6-8b00-12ec28d2c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:25.283344 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-d3f5c95e-67af-45f6-8b00-12ec28d2c19f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:25.284493 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d3f5c95e-67af-45f6-8b00-12ec28d2c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:25.292783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 476/969] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:25.627293 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bdd5-2374-4524-8713-455fbe66f8ac None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:25.638115 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8bdd5-2374-4524-8713-455fbe66f8ac None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:25.641980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:25.642600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:25.642875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:25.643134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:25.653004 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:25.654508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5718-10cc-4963-b9e3-3b9fc0665bdd service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:25.664217 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 494/970] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:31.160605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d973e7-bd81-4371-9899-0bfc3e82b838 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:31.161135 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d973e7-bd81-4371-9899-0bfc3e82b838 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:31.161135 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d973e7-bd81-4371-9899-0bfc3e82b838 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:31.163088 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 477/971] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:31.170625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd89a-cd1b-4e57-9ea4-16d897cbb8c7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:31.171513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd89a-cd1b-4e57-9ea4-16d897cbb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:31.171989 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd89a-cd1b-4e57-9ea4-16d897cbb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:31.234953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-892bd89a-cd1b-4e57-9ea4-16d897cbb8c7 None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:31.238011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-892bd89a-cd1b-4e57-9ea4-16d897cbb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:31.352632 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 495/972] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:13:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:35.278776 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=8 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:36.096367 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6949cb-aa5a-4ae6-801b-a5abb582fb56 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:36.096640 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6949cb-aa5a-4ae6-801b-a5abb582fb56 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:36.097477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6949cb-aa5a-4ae6-801b-a5abb582fb56 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:36.098861 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 478/973] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:36.104237 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9f85-58f7-4869-aa7c-8b7a85985876 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:36.104771 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9f85-58f7-4869-aa7c-8b7a85985876 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:36.104771 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9f85-58f7-4869-aa7c-8b7a85985876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:36.112999 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=66 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:36.126618 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a6ed9f85-58f7-4869-aa7c-8b7a85985876 None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:36.127962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a6ed9f85-58f7-4869-aa7c-8b7a85985876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:36.137370 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 496/974] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:13:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:37.666549 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b6aa-0bf2-47d8-a7c6-3c66e5217921 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:37.667063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b6aa-0bf2-47d8-a7c6-3c66e5217921 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:37.667063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420b6aa-0bf2-47d8-a7c6-3c66e5217921 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:37.668397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 479/975] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:37.673936 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6f72a-eb75-4476-838c-865785209de0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:37.674365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6f72a-eb75-4476-838c-865785209de0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:37.674715 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6f72a-eb75-4476-838c-865785209de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:37.693769 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-96e6f72a-eb75-4476-838c-865785209de0 None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:37.694973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-96e6f72a-eb75-4476-838c-865785209de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:37.703879 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 497/976] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:13:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:13:41.837123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbcb-6944-48bb-95f3-003d776f7694 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:41.837682 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbcb-6944-48bb-95f3-003d776f7694 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:41.837931 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0fbcb-6944-48bb-95f3-003d776f7694 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:41.839588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 480/977] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:41.844849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265151-3b97-45a6-b5f5-62d2836c74a9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:41.845644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265151-3b97-45a6-b5f5-62d2836c74a9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:41.846083 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3265151-3b97-45a6-b5f5-62d2836c74a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:41.866186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c3265151-3b97-45a6-b5f5-62d2836c74a9 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:41.867638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c3265151-3b97-45a6-b5f5-62d2836c74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:41.876234 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 498/978] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:42.240127 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5457bd-250d-4303-9014-2bb78df1417c None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:42.240884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5457bd-250d-4303-9014-2bb78df1417c None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:42.241385 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5457bd-250d-4303-9014-2bb78df1417c None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:42.243670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 481/979] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 9 11:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:42.256193 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8e5-07cf-4f64-8380-d1b2ac4abb85 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:42.256905 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8e5-07cf-4f64-8380-d1b2ac4abb85 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:42.257389 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8e5-07cf-4f64-8380-d1b2ac4abb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:42.302745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2ff7b8e5-07cf-4f64-8380-d1b2ac4abb85 None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:42.303930 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2ff7b8e5-07cf-4f64-8380-d1b2ac4abb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:42.387067 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 499/980] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 9 11:13:42 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:42.395689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5457bd-250d-4303-9014-2bb78df1417c None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:42.410949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5457bd-250d-4303-9014-2bb78df1417c None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:42.416043 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:42.416660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:42.416983 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:42.417209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:42.426590 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:42.428209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e19e5-3be4-418f-87d2-8a5e3a3df517 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:42.438956 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 482/981] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:45.220025 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2cea-d452-48e6-a72a-1ba792ea7a72 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:45.221647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2cea-d452-48e6-a72a-1ba792ea7a72 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:45.222217 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2cea-d452-48e6-a72a-1ba792ea7a72 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:45.225091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 500/982] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:45.231531 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d256b6b-3bf2-4742-83b6-57d375e92e81 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:45.232167 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d256b6b-3bf2-4742-83b6-57d375e92e81 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:45.232167 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d256b6b-3bf2-4742-83b6-57d375e92e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:45.252627 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-8d256b6b-3bf2-4742-83b6-57d375e92e81 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:45.253732 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-8d256b6b-3bf2-4742-83b6-57d375e92e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:45.261900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 483/983] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:45.822838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e2cea-d452-48e6-a72a-1ba792ea7a72 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:45.848109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e2cea-d452-48e6-a72a-1ba792ea7a72 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:45.855608 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:45.856264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:45.856668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:45.856941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:45.872166 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:45.873791 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40662c2-11ac-406b-bbc6-8a85df95672e service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:45.891980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 501/984] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:48.863697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7352-33e0-46de-945e-fc4d8a02c93a None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:48.864547 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7352-33e0-46de-945e-fc4d8a02c93a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:48.864829 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f7352-33e0-46de-945e-fc4d8a02c93a None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:48.866380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 484/985] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:48.872523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d37b5-9774-4dd0-be29-53dbb9120295 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:48.873072 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d37b5-9774-4dd0-be29-53dbb9120295 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:48.873152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d37b5-9774-4dd0-be29-53dbb9120295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:48.903471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-801d37b5-9774-4dd0-be29-53dbb9120295 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:48.905485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-801d37b5-9774-4dd0-be29-53dbb9120295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:48.915106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 502/986] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:49.294153 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141082-fa3b-4131-8ca9-0ae955b331e4 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:49.294508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141082-fa3b-4131-8ca9-0ae955b331e4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:49.294784 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141082-fa3b-4131-8ca9-0ae955b331e4 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:49.296324 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 485/987] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 9 11:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:49.305944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eaad-d791-4eb9-a464-70fb046a1611 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:49.306606 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eaad-d791-4eb9-a464-70fb046a1611 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:49.307127 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9eaad-d791-4eb9-a464-70fb046a1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:49.337546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-41c9eaad-d791-4eb9-a464-70fb046a1611 None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:49.338055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-41c9eaad-d791-4eb9-a464-70fb046a1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:49.350733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 503/988] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 9 11:13:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:49.359877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141082-fa3b-4131-8ca9-0ae955b331e4 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:49.376458 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141082-fa3b-4131-8ca9-0ae955b331e4 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:49.382537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:49.383496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:49.383771 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:49.384034 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:49.394820 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:49.396351 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6acc549-cd0d-4440-ae03-9314390910ae service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:49.409274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 486/989] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:52.085168 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98120de-a992-4d39-8d54-45242a08fa53 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:52.086116 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98120de-a992-4d39-8d54-45242a08fa53 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:52.086569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98120de-a992-4d39-8d54-45242a08fa53 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:52.094602 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be344a-9a2d-4a34-a813-c473e5343a24 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:52.095510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be344a-9a2d-4a34-a813-c473e5343a24 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:52.096004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be344a-9a2d-4a34-a813-c473e5343a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:52.099240 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 504/990] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:52.117435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-b7be344a-9a2d-4a34-a813-c473e5343a24 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:52.119042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b7be344a-9a2d-4a34-a813-c473e5343a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:52.139267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 487/991] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:52.491568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98120de-a992-4d39-8d54-45242a08fa53 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:52.509081 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98120de-a992-4d39-8d54-45242a08fa53 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:52.515868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:52.516722 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:52.517203 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:52.517697 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:52.527508 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:52.530581 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67ab73-91a8-4398-b735-2d4202452568 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:52.561904 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 505/992] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:52.977199 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702be85-2fc7-46f3-b05e-e2d75d4ef9e8 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:52.977749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702be85-2fc7-46f3-b05e-e2d75d4ef9e8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:52.978023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702be85-2fc7-46f3-b05e-e2d75d4ef9e8 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:52.986143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41eea-d3f2-4019-8eab-ebdebb1548de None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:52.986469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41eea-d3f2-4019-8eab-ebdebb1548de None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:52.987286 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb41eea-d3f2-4019-8eab-ebdebb1548de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:52.990411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 488/993] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:53.019049 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fdb41eea-d3f2-4019-8eab-ebdebb1548de None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:53.020495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fdb41eea-d3f2-4019-8eab-ebdebb1548de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:53.034851 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 506/994] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:13:53.432022 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa57a8-038c-4215-85cd-1640aaa92705 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:53.432881 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa57a8-038c-4215-85cd-1640aaa92705 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:53.433289 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa57a8-038c-4215-85cd-1640aaa92705 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:53.435331 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 489/995] 10.222.0.25 () {54 vars in 964 bytes} [Fri Sep 9 11:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:53.442159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902b27-e511-4df1-9b9e-aeabc04bf426 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:53.442995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902b27-e511-4df1-9b9e-aeabc04bf426 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:53.443472 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902b27-e511-4df1-9b9e-aeabc04bf426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:53.483991 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a3902b27-e511-4df1-9b9e-aeabc04bf426 None None] MFA Rules not processed for user `397af280379f4d7c87ffad8b19d76100`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:53.485478 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a3902b27-e511-4df1-9b9e-aeabc04bf426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:53.542178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:13:53.548824 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 507/996] 10.222.0.25 () {58 vars in 1061 bytes} [Fri Sep 9 11:13:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:53.556425 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa57a8-038c-4215-85cd-1640aaa92705 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:53.567901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa57a8-038c-4215-85cd-1640aaa92705 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:53.571480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397af280379f4d7c87ffad8b19d76100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:53.572356 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:53.572800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:53.573073 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:53.583167 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:53.584573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de857c-1dc8-47f2-a705-a8601dd41881 service cinder] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:53.594966 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 490/997] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:55.177484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c377-c60c-4ecc-8f0d-95f0bdb51f69 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:55.178000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c377-c60c-4ecc-8f0d-95f0bdb51f69 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:55.178000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c377-c60c-4ecc-8f0d-95f0bdb51f69 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:55.179507 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 508/998] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:55.185259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5f7-633a-4404-809d-d9e619aeef54 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:55.185725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5f7-633a-4404-809d-d9e619aeef54 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:55.185841 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272e5f7-633a-4404-809d-d9e619aeef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:55.207802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c272e5f7-633a-4404-809d-d9e619aeef54 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:55.209142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c272e5f7-633a-4404-809d-d9e619aeef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:55.219229 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 491/999] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:55.570752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c377-c60c-4ecc-8f0d-95f0bdb51f69 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:55.585647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c377-c60c-4ecc-8f0d-95f0bdb51f69 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:55.591095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:55.591691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:55.591963 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:55.592259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:55.601606 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:55.603247 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c6772-3792-417b-94bb-7de7c9e850e3 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:55.612804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 509/1000] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:13:58.115335 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e95b9-f693-4610-af6d-ea976866a156 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:58.115895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e95b9-f693-4610-af6d-ea976866a156 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:58.115895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e95b9-f693-4610-af6d-ea976866a156 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:58.117272 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 492/1001] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:13:58.123112 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c19e2-d4e8-4bea-b512-5387e9d92c4c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:58.124042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c19e2-d4e8-4bea-b512-5387e9d92c4c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:58.124454 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c19e2-d4e8-4bea-b512-5387e9d92c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:58.144638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f04c19e2-d4e8-4bea-b512-5387e9d92c4c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:13:58.146046 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f04c19e2-d4e8-4bea-b512-5387e9d92c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:13:58.154267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 510/1002] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:13:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:13:58.503178 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e95b9-f693-4610-af6d-ea976866a156 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:13:58.517796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e95b9-f693-4610-af6d-ea976866a156 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:13:58.522883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:13:58.523496 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:13:58.523786 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:13:58.524058 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:13:58.533218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:13:58.534825 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7b48a-98a2-406b-b2dd-1c0820cd24f1 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:13:58.546660 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 493/1003] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:13:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:01.033783 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a951-c0c1-46de-9a15-5d6044ae5b59 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:01.034288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a951-c0c1-46de-9a15-5d6044ae5b59 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:01.034288 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97a951-c0c1-46de-9a15-5d6044ae5b59 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:01.036390 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 511/1004] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:01.041711 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05c890-560d-43c1-9360-969e6c3de6af None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:01.042153 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05c890-560d-43c1-9360-969e6c3de6af None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:01.042232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05c890-560d-43c1-9360-969e6c3de6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:01.063451 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-1a05c890-560d-43c1-9360-969e6c3de6af None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:01.064665 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-1a05c890-560d-43c1-9360-969e6c3de6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:01.073538 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 494/1005] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:01.429769 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97a951-c0c1-46de-9a15-5d6044ae5b59 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:01.449519 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97a951-c0c1-46de-9a15-5d6044ae5b59 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:01.456326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:01.456934 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:01.457210 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:01.457485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:01.466530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:01.468153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327cc65-5b07-4846-a57b-b92a598ec5da service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:01.478657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 512/1006] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:04.020245 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4e2-a22b-446a-a6d2-5ee421e55d7e None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:04.040130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4e2-a22b-446a-a6d2-5ee421e55d7e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:04.040130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460b4e2-a22b-446a-a6d2-5ee421e55d7e None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:04.040130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 495/1007] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:04.040800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4a83-5f7f-43ee-8919-d87856bd1615 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:04.040800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4a83-5f7f-43ee-8919-d87856bd1615 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:04.040800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b4a83-5f7f-43ee-8919-d87856bd1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:04.054329 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e79b4a83-5f7f-43ee-8919-d87856bd1615 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:04.055628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e79b4a83-5f7f-43ee-8919-d87856bd1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:04.065611 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 513/1008] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:04.427066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460b4e2-a22b-446a-a6d2-5ee421e55d7e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:04.455103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460b4e2-a22b-446a-a6d2-5ee421e55d7e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:04.460411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:04.461044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:04.461346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:04.461609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:04.475233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:04.477000 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819e717-a54b-4035-b82e-626f5c6c1d23 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:04.487345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 496/1009] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:07.646249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ec02-312b-4b81-bcc2-744c98e09c21 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:07.646919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ec02-312b-4b81-bcc2-744c98e09c21 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:07.646919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3ec02-312b-4b81-bcc2-744c98e09c21 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:07.648576 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 514/1010] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:07.654941 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba53f3-ac3f-43be-a32c-e0220ca1ff36 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:07.656016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba53f3-ac3f-43be-a32c-e0220ca1ff36 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:07.656016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba53f3-ac3f-43be-a32c-e0220ca1ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:07.663567 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=43 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:14:07.678920 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-91ba53f3-ac3f-43be-a32c-e0220ca1ff36 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:07.680142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-91ba53f3-ac3f-43be-a32c-e0220ca1ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:07.688748 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 497/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:08.038282 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3ec02-312b-4b81-bcc2-744c98e09c21 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:08.052432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3ec02-312b-4b81-bcc2-744c98e09c21 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:08.058381 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:08.059018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:08.059302 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:08.059575 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:08.069939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:08.071550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d2eea-49a1-4004-bdb7-a9b5f9ee00c4 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:08.081860 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 515/1012] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:09.870913 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613912b3-057a-4ffe-8917-01b45a3e5af2 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:09.871527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613912b3-057a-4ffe-8917-01b45a3e5af2 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:09.871527 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613912b3-057a-4ffe-8917-01b45a3e5af2 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:09.872751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 498/1013] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:09.878653 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380268c-c2ef-4a3b-a3c2-039bcc547169 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:09.879170 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380268c-c2ef-4a3b-a3c2-039bcc547169 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:09.879170 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380268c-c2ef-4a3b-a3c2-039bcc547169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:09.899021 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-a380268c-c2ef-4a3b-a3c2-039bcc547169 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:09.900186 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a380268c-c2ef-4a3b-a3c2-039bcc547169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:09.908038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 516/1014] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:10.263515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54933d6-da1c-4d14-87c9-66229d9ab0cf None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.263875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54933d6-da1c-4d14-87c9-66229d9ab0cf None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.264219 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54933d6-da1c-4d14-87c9-66229d9ab0cf None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.266191 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 499/1015] 10.222.0.25 () {54 vars in 966 bytes} [Fri Sep 9 11:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:10.271717 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079f0d-2d46-431d-87d7-8cadbfcd9293 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.272041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079f0d-2d46-431d-87d7-8cadbfcd9293 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.272318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079f0d-2d46-431d-87d7-8cadbfcd9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.310338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-32079f0d-2d46-431d-87d7-8cadbfcd9293 None None] MFA Rules not processed for user `17bcafde41734dbe8c9a400aa9bbf802`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:10.311556 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-32079f0d-2d46-431d-87d7-8cadbfcd9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:10.371386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 517/1016] 10.222.0.25 () {58 vars in 1063 bytes} [Fri Sep 9 11:14:10 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:10.379301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54933d6-da1c-4d14-87c9-66229d9ab0cf None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:10.390727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54933d6-da1c-4d14-87c9-66229d9ab0cf None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:10.394177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bcafde41734dbe8c9a400aa9bbf802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:10.394899 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.395247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.395585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.405192 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:10.407330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3913c6-7b79-47a6-98cf-ed8fdbed283a service glance] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:10.417891 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 500/1017] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:10.535397 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500953-4280-4f16-8ef1-e3b524be838e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.535619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500953-4280-4f16-8ef1-e3b524be838e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.535869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500953-4280-4f16-8ef1-e3b524be838e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.537235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 518/1018] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:10.542781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a5d-a296-40b4-8a06-a60a5fbcd68f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.543069 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a5d-a296-40b4-8a06-a60a5fbcd68f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.543345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a5d-a296-40b4-8a06-a60a5fbcd68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.563003 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f4579a5d-a296-40b4-8a06-a60a5fbcd68f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:10.564180 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f4579a5d-a296-40b4-8a06-a60a5fbcd68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:10.572081 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 501/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:10.930680 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b500953-4280-4f16-8ef1-e3b524be838e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:10.945631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b500953-4280-4f16-8ef1-e3b524be838e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:10.951258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:10.951908 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:10.952279 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:10.952492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:10.962654 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:10.964236 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd758d-5c6e-44c8-820d-b6777ba86a29 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:10.974694 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 519/1020] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:13.518917 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4902-0bbd-4a78-80b1-774c445654c5 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:13.519571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4902-0bbd-4a78-80b1-774c445654c5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:13.519571 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4902-0bbd-4a78-80b1-774c445654c5 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:13.522206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 502/1021] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:13.527017 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20288e-f05f-4e5b-b928-8d5ccd884231 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:13.528810 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20288e-f05f-4e5b-b928-8d5ccd884231 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:13.528810 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20288e-f05f-4e5b-b928-8d5ccd884231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:13.547995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-3a20288e-f05f-4e5b-b928-8d5ccd884231 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:13.549208 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-3a20288e-f05f-4e5b-b928-8d5ccd884231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:13.557966 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 520/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:13.901975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4902-0bbd-4a78-80b1-774c445654c5 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:13.915346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4902-0bbd-4a78-80b1-774c445654c5 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:13.920232 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:13.920832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:13.921104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:13.921871 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:13.930779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:13.932345 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571c481-4a70-4e9f-af58-07e382af7d62 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:13.943020 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 503/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:16.617485 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b089-6367-4f63-8f9b-143253b596a8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:16.618200 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b089-6367-4f63-8f9b-143253b596a8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:16.618200 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27b089-6367-4f63-8f9b-143253b596a8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:16.619435 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 521/1024] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:16.627341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d212c4-3dfc-4d9f-ab99-e9e8d49ed958 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:16.627963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d212c4-3dfc-4d9f-ab99-e9e8d49ed958 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:16.627963 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d212c4-3dfc-4d9f-ab99-e9e8d49ed958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:16.648333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-37d212c4-3dfc-4d9f-ab99-e9e8d49ed958 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:16.649578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-37d212c4-3dfc-4d9f-ab99-e9e8d49ed958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:16.660529 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 504/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:14:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:17.013804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27b089-6367-4f63-8f9b-143253b596a8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:17.029014 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27b089-6367-4f63-8f9b-143253b596a8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:17.039612 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:17.042291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:17.042291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:17.042291 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:17.061541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:17.063296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07d2e1-a9d8-4738-82c9-f0e0e673e654 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:17.074008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 522/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:25.961442 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574bd-36cc-4094-a908-1efe1664ad84 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:25.962106 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574bd-36cc-4094-a908-1efe1664ad84 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:25.962106 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574bd-36cc-4094-a908-1efe1664ad84 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:25.963347 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 505/1027] 10.222.0.25 () {54 vars in 918 bytes} [Fri Sep 9 11:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:25.968478 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0e5a-3367-476d-84df-33e57f233f34 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:25.969015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0e5a-3367-476d-84df-33e57f233f34 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:25.969109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb0e5a-3367-476d-84df-33e57f233f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:25.976594 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=77 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:14:25.990612 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fffb0e5a-3367-476d-84df-33e57f233f34 None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:25.991832 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fffb0e5a-3367-476d-84df-33e57f233f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:26.001071 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 523/1028] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 9 11:14:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:26.016303 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5310e6-92d5-4904-9d83-bcf75f42b3f5 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:26.016580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5310e6-92d5-4904-9d83-bcf75f42b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:26.016850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5310e6-92d5-4904-9d83-bcf75f42b3f5 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:26.018175 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 506/1029] 10.222.0.25 () {54 vars in 918 bytes} [Fri Sep 9 11:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:26.023075 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f394a-0513-45fc-bae7-120c72178a5c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:26.023356 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f394a-0513-45fc-bae7-120c72178a5c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:26.023626 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f394a-0513-45fc-bae7-120c72178a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:26.043753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ee5f394a-0513-45fc-bae7-120c72178a5c None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:26.044927 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ee5f394a-0513-45fc-bae7-120c72178a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:26.053384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 524/1030] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 9 11:14:26 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:26.642883 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=20 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:14:28.905104 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1f71-b38e-46d7-80b0-da6c97603f51 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:28.905895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1f71-b38e-46d7-80b0-da6c97603f51 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:28.905895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1f71-b38e-46d7-80b0-da6c97603f51 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:28.907176 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:28.912365 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fffb2-ee52-406d-89dc-08a950bbafb4 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:28.912744 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fffb2-ee52-406d-89dc-08a950bbafb4 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:28.912904 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fffb2-ee52-406d-89dc-08a950bbafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:28.932106 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-396fffb2-ee52-406d-89dc-08a950bbafb4 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:28.933268 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-396fffb2-ee52-406d-89dc-08a950bbafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:28.941733 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:14:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:29.282143 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b1f71-b38e-46d7-80b0-da6c97603f51 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:29.295785 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b1f71-b38e-46d7-80b0-da6c97603f51 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:29.301299 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:29.301880 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:29.302152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:29.302454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:29.310310 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:29.311887 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0498d-764f-4fec-8002-bfe7539f27ef service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:29.320931 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 508/1033] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:31.013189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01491-27b5-4225-9661-0e8ba54a51ab None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:31.013759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01491-27b5-4225-9661-0e8ba54a51ab None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:31.013759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01491-27b5-4225-9661-0e8ba54a51ab None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:31.015093 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:31.022228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549eb88-4fa5-4cf3-9ecd-758c6aa8fc8b None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:31.022743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549eb88-4fa5-4cf3-9ecd-758c6aa8fc8b None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:31.022851 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549eb88-4fa5-4cf3-9ecd-758c6aa8fc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:31.044034 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-0549eb88-4fa5-4cf3-9ecd-758c6aa8fc8b None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:31.045217 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-0549eb88-4fa5-4cf3-9ecd-758c6aa8fc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:31.052968 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:31.257044 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01491-27b5-4225-9661-0e8ba54a51ab None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:31.272318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01491-27b5-4225-9661-0e8ba54a51ab None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:31.280069 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:31.280663 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:31.280934 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:31.281198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:31.291784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:31.293518 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef475f9-034c-45b7-921e-fc9b6cae3629 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:31.303493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 527/1036] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:33.049260 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d9df-c01b-48d1-8b63-fd4dfc4f4c7b None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:33.049876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d9df-c01b-48d1-8b63-fd4dfc4f4c7b None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:33.049876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683d9df-c01b-48d1-8b63-fd4dfc4f4c7b None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:33.051309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:33.057530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e5e-46fd-4745-b14d-06e1b8aaad03 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:33.057985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e5e-46fd-4745-b14d-06e1b8aaad03 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:33.058476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1e5e-46fd-4745-b14d-06e1b8aaad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:33.082017 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ac3a1e5e-46fd-4745-b14d-06e1b8aaad03 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:33.083297 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ac3a1e5e-46fd-4745-b14d-06e1b8aaad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:33.091317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:33.252151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683d9df-c01b-48d1-8b63-fd4dfc4f4c7b None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:33.267395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683d9df-c01b-48d1-8b63-fd4dfc4f4c7b None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:33.272643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:33.273275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:33.273545 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:33.273815 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:33.283731 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:33.285517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97966-b83d-4f5c-ab15-d912963092be service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:33.296059 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 511/1039] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:14:35.032635 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5be03-b5d5-4a1d-8610-a2f4623d270b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:35.033308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5be03-b5d5-4a1d-8610-a2f4623d270b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:35.033308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5be03-b5d5-4a1d-8610-a2f4623d270b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:35.034704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:14:35.040833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8450e-a785-4546-b0be-ab0d2e56832c None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:35.041605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8450e-a785-4546-b0be-ab0d2e56832c None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:35.041605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8450e-a785-4546-b0be-ab0d2e56832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:35.062929 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-a7d8450e-a785-4546-b0be-ab0d2e56832c None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:35.064202 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-a7d8450e-a785-4546-b0be-ab0d2e56832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:35.072606 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:35.239696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5be03-b5d5-4a1d-8610-a2f4623d270b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:35.257175 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5be03-b5d5-4a1d-8610-a2f4623d270b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:35.263636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:35.264642 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:35.265122 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:35.265609 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:35.282862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:35.285696 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3678a4-30a9-498b-9972-5556f4dda699 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:35.302002 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 530/1042] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:37.096698 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c25-fab4-4069-9e59-2067bf918509 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:37.097486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c25-fab4-4069-9e59-2067bf918509 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:37.097486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52326c25-fab4-4069-9e59-2067bf918509 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:37.098631 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:37.104062 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c894c-e12c-49a6-aa35-4c95556cb3f7 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:37.104616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c894c-e12c-49a6-aa35-4c95556cb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:37.104616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c894c-e12c-49a6-aa35-4c95556cb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:37.125441 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-503c894c-e12c-49a6-aa35-4c95556cb3f7 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:37.126689 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-503c894c-e12c-49a6-aa35-4c95556cb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:37.135746 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:37.311925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326c25-fab4-4069-9e59-2067bf918509 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:37.326376 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52326c25-fab4-4069-9e59-2067bf918509 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:37.332500 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:37.333244 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:37.333522 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:37.333791 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:37.343592 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:37.346005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b135f5-9474-4248-80bd-a894e0fd9712 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:37.357416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 514/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:39.106838 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883524-f5b9-4423-8760-f8667829d288 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:39.107464 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883524-f5b9-4423-8760-f8667829d288 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:39.107464 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20883524-f5b9-4423-8760-f8667829d288 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:39.108719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:39.115102 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d563-0bed-4de6-83f0-7b0de230c04a None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:39.115686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d563-0bed-4de6-83f0-7b0de230c04a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:39.115686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d563-0bed-4de6-83f0-7b0de230c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:39.142004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-be69d563-0bed-4de6-83f0-7b0de230c04a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:39.144097 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-be69d563-0bed-4de6-83f0-7b0de230c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:39.158848 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:39.337820 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883524-f5b9-4423-8760-f8667829d288 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:39.353347 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20883524-f5b9-4423-8760-f8667829d288 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:39.358749 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:39.359294 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:39.359573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:39.359900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:39.370022 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:39.371804 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c52b6-6426-43bf-af72-2b077300f6df service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:39.384063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 533/1048] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:14:41.195704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238e00-2ea3-48c6-be77-dc087b132423 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:41.196254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238e00-2ea3-48c6-be77-dc087b132423 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:41.196254 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238e00-2ea3-48c6-be77-dc087b132423 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:41.197575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:41.204063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906b45-b8e9-43da-b122-a5ae8ce0e296 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:41.204545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906b45-b8e9-43da-b122-a5ae8ce0e296 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:41.204802 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906b45-b8e9-43da-b122-a5ae8ce0e296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:41.236199 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-fa906b45-b8e9-43da-b122-a5ae8ce0e296 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:41.238140 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-fa906b45-b8e9-43da-b122-a5ae8ce0e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:41.249420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:41.418456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa238e00-2ea3-48c6-be77-dc087b132423 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:41.439878 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa238e00-2ea3-48c6-be77-dc087b132423 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:41.448046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:41.448637 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:41.448928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:41.449350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:41.462825 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:41.465028 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d0475-f376-4f8c-94a7-d031fa0b739a service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:41.479296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 517/1051] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:43.217861 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42cc5-5e5d-4b32-9b06-94a6325933c8 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:43.218555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42cc5-5e5d-4b32-9b06-94a6325933c8 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:43.218555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42cc5-5e5d-4b32-9b06-94a6325933c8 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:43.220165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:43.226140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493c0-b4ba-48ed-9c11-edbc9788943b None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:43.226763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493c0-b4ba-48ed-9c11-edbc9788943b None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:43.226763 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220493c0-b4ba-48ed-9c11-edbc9788943b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:43.248946 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-220493c0-b4ba-48ed-9c11-edbc9788943b None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:43.250174 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-220493c0-b4ba-48ed-9c11-edbc9788943b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:43.258940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:14:43.424163 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42cc5-5e5d-4b32-9b06-94a6325933c8 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:43.440660 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42cc5-5e5d-4b32-9b06-94a6325933c8 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:43.447160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:43.447779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:43.448056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:43.448330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:43.458544 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:43.460198 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ce231-efea-4c3c-8a32-8ddeaab6802b service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:43.472446 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 536/1054] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:45.184275 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093474a-d858-4c53-9b98-71715ed7f6a5 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:45.184760 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093474a-d858-4c53-9b98-71715ed7f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:45.184860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093474a-d858-4c53-9b98-71715ed7f6a5 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:45.186492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:45.192238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eba51-30f2-4ff5-a353-c2d9405ab244 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:45.192898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eba51-30f2-4ff5-a353-c2d9405ab244 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:45.192898 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eba51-30f2-4ff5-a353-c2d9405ab244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:45.214227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f00eba51-30f2-4ff5-a353-c2d9405ab244 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:45.215484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f00eba51-30f2-4ff5-a353-c2d9405ab244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:45.226656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:14:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:45.398251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093474a-d858-4c53-9b98-71715ed7f6a5 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:45.412669 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093474a-d858-4c53-9b98-71715ed7f6a5 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:45.417572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:45.418171 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:45.418574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:45.418859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:45.428416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:45.430207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf615f-8ac0-4e32-a5f0-d2241bed71fc service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:45.441794 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 520/1057] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:47.952479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0f721-e2bc-4500-b33c-04f46bce8a52 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:47.953167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0f721-e2bc-4500-b33c-04f46bce8a52 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:47.953167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0f721-e2bc-4500-b33c-04f46bce8a52 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:47.954431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:47.960854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb437-d51e-4c8c-872f-eec69b4c8159 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:47.961411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb437-d51e-4c8c-872f-eec69b4c8159 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:47.961790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb437-d51e-4c8c-872f-eec69b4c8159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:47.991523 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-47ddb437-d51e-4c8c-872f-eec69b4c8159 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:47.992771 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-47ddb437-d51e-4c8c-872f-eec69b4c8159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:48.000685 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:14:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:48.340781 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0f721-e2bc-4500-b33c-04f46bce8a52 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:48.352151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0f721-e2bc-4500-b33c-04f46bce8a52 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:48.355787 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:48.356385 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:48.356649 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:48.356914 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:48.367553 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:48.368988 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc9276-9d06-4aae-b59e-74e222d6bc09 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:48.380109 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 539/1060] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:14:51.163475 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4eb2-73e6-4961-8ec1-ae3f38f1cd30 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:51.164094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4eb2-73e6-4961-8ec1-ae3f38f1cd30 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:51.164094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4eb2-73e6-4961-8ec1-ae3f38f1cd30 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:51.165385 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:51.171141 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d7c9-9886-4e2e-b36f-4fef49cf851a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:51.171624 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d7c9-9886-4e2e-b36f-4fef49cf851a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:51.171742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005d7c9-9886-4e2e-b36f-4fef49cf851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:51.191729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-2005d7c9-9886-4e2e-b36f-4fef49cf851a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:51.192941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-2005d7c9-9886-4e2e-b36f-4fef49cf851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:51.200761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:14:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:51.544464 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4eb2-73e6-4961-8ec1-ae3f38f1cd30 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:51.558961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4eb2-73e6-4961-8ec1-ae3f38f1cd30 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:51.562637 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:51.563823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:51.564086 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:51.564354 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:51.574085 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:51.575561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98460c4-1453-44db-bad7-5ebe6981c324 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:51.585686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 523/1063] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:54.574051 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affdc5a-aa7e-4ec2-ac19-239cd6987075 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:54.574628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affdc5a-aa7e-4ec2-ac19-239cd6987075 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:54.574628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affdc5a-aa7e-4ec2-ac19-239cd6987075 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:54.575970 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:54.583215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70ce7-7717-482e-b231-355bd32dcf7e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:54.584107 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70ce7-7717-482e-b231-355bd32dcf7e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:54.584279 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70ce7-7717-482e-b231-355bd32dcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:54.606541 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-12e70ce7-7717-482e-b231-355bd32dcf7e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:54.607749 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-12e70ce7-7717-482e-b231-355bd32dcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:54.616561 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:14:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:54.992249 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affdc5a-aa7e-4ec2-ac19-239cd6987075 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:55.004185 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affdc5a-aa7e-4ec2-ac19-239cd6987075 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:55.008131 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:55.008731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:55.009006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:55.009369 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:55.020209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:55.021648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8b9f6-cc53-42d3-8e23-5f460f7d6adf service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:55.032476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 542/1066] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:14:57.747668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e7fc1-8713-4252-8575-6a7396de068e None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:57.748229 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e7fc1-8713-4252-8575-6a7396de068e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:57.748229 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e7fc1-8713-4252-8575-6a7396de068e None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:57.749456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:14:57.755192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f536-d907-49e7-81df-8117103ab1e2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:57.755976 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f536-d907-49e7-81df-8117103ab1e2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:57.756147 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f536-d907-49e7-81df-8117103ab1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:57.764078 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=60 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:14:57.783598 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-8922f536-d907-49e7-81df-8117103ab1e2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:14:57.784880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-8922f536-d907-49e7-81df-8117103ab1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:14:57.793167 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:14:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:14:58.143170 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e7fc1-8713-4252-8575-6a7396de068e None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:14:58.150797 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=55 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:14:58.158974 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e7fc1-8713-4252-8575-6a7396de068e None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:14:58.163024 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:14:58.163692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:14:58.163973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:14:58.164325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:14:58.175271 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:14:58.176743 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5fdf5-1801-4a02-ab46-a0fa35fe0937 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:14:58.187128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 526/1069] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:14:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:00.758719 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ad11-dfa4-479e-b67c-45801968ad38 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:00.759251 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ad11-dfa4-479e-b67c-45801968ad38 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:00.759251 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515ad11-dfa4-479e-b67c-45801968ad38 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:00.760517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:00.765912 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720ae5-efb4-4985-8099-6426a2ca6651 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:00.766340 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720ae5-efb4-4985-8099-6426a2ca6651 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:00.766516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720ae5-efb4-4985-8099-6426a2ca6651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:00.786046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-35720ae5-efb4-4985-8099-6426a2ca6651 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:00.787290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-35720ae5-efb4-4985-8099-6426a2ca6651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:00.795017 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:01.133292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515ad11-dfa4-479e-b67c-45801968ad38 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:01.144848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515ad11-dfa4-479e-b67c-45801968ad38 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:01.148335 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:01.148921 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:01.149197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:01.149467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:01.158742 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:01.160158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e115500-4ab4-4022-b7a9-b20e1ea2c317 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:01.169489 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 545/1072] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:03.716678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a2d4-f561-40d3-b73a-c3404be65db2 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:03.717208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a2d4-f561-40d3-b73a-c3404be65db2 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:03.717208 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6a2d4-f561-40d3-b73a-c3404be65db2 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:03.718494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:03.724795 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf26c1d-a47b-4132-80e4-ba42a30297d1 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:03.725319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf26c1d-a47b-4132-80e4-ba42a30297d1 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:03.725319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf26c1d-a47b-4132-80e4-ba42a30297d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:03.744768 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-abf26c1d-a47b-4132-80e4-ba42a30297d1 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:03.745958 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-abf26c1d-a47b-4132-80e4-ba42a30297d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:03.755102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:04.093115 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6a2d4-f561-40d3-b73a-c3404be65db2 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:04.104404 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6a2d4-f561-40d3-b73a-c3404be65db2 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:04.108190 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:04.108809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:04.109089 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:04.109361 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:04.119796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:04.121239 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdef7a-00d7-4dbd-b246-3feebebc41d7 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:04.133384 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 529/1075] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:06.673708 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ae46-882d-403f-ac11-336491602928 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:06.674223 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ae46-882d-403f-ac11-336491602928 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:06.674223 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ae46-882d-403f-ac11-336491602928 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:06.675537 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:06.681125 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715c3a-fc05-4435-9934-4b357fc471af None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:06.681584 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715c3a-fc05-4435-9934-4b357fc471af None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:06.681683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715c3a-fc05-4435-9934-4b357fc471af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:06.700606 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-3a715c3a-fc05-4435-9934-4b357fc471af None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:06.701793 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-3a715c3a-fc05-4435-9934-4b357fc471af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:06.709800 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:07.047091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92ae46-882d-403f-ac11-336491602928 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:07.057947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92ae46-882d-403f-ac11-336491602928 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:07.061493 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:07.062102 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:07.062472 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:07.062747 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:07.073120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:07.074605 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b792419-feb0-4660-aaaf-8eb56de620e1 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:07.085534 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 548/1078] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:09.563284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6251e-5b7b-479e-b87d-92dc6d0568b0 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:09.564026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6251e-5b7b-479e-b87d-92dc6d0568b0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:09.564026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6251e-5b7b-479e-b87d-92dc6d0568b0 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:09.565280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:09.571522 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb063-1492-4aed-b1a3-88908d64aaf0 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:09.572062 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb063-1492-4aed-b1a3-88908d64aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:09.572062 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb063-1492-4aed-b1a3-88908d64aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:09.593342 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e90cb063-1492-4aed-b1a3-88908d64aaf0 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:09.595470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e90cb063-1492-4aed-b1a3-88908d64aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:09.603114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:09.948005 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6251e-5b7b-479e-b87d-92dc6d0568b0 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:09.958829 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6251e-5b7b-479e-b87d-92dc6d0568b0 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:09.962252 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:09.962863 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:09.963139 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:09.963407 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:09.972700 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:09.974116 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa2d2-f4ec-4a27-a108-118f7d30aa19 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:09.984469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 532/1081] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:12.442603 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301e7b8-8a87-4d83-9ff3-d28aa1adb63e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:12.443098 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301e7b8-8a87-4d83-9ff3-d28aa1adb63e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:12.443205 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301e7b8-8a87-4d83-9ff3-d28aa1adb63e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:12.444499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:12.450198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953277-011b-4e15-9967-ca832c8edfa1 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:12.450658 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953277-011b-4e15-9967-ca832c8edfa1 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:12.450779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953277-011b-4e15-9967-ca832c8edfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:12.470075 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e8953277-011b-4e15-9967-ca832c8edfa1 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:12.471352 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e8953277-011b-4e15-9967-ca832c8edfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:12.479116 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:12.812778 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301e7b8-8a87-4d83-9ff3-d28aa1adb63e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:12.823823 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301e7b8-8a87-4d83-9ff3-d28aa1adb63e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:12.827523 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:12.828103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:12.828382 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:12.828648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:12.837885 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:12.839337 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc01514-d4d3-4b68-a94f-8bd7413e2498 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:12.848468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 551/1084] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:15.296370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf62a4-2956-4743-a40d-9146a290d1ae None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:15.296925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf62a4-2956-4743-a40d-9146a290d1ae None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:15.296925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf62a4-2956-4743-a40d-9146a290d1ae None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:15.298833 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:15.304119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe855f-2a52-49c2-a759-d8a8cdfd0343 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:15.304570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe855f-2a52-49c2-a759-d8a8cdfd0343 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:15.304666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe855f-2a52-49c2-a759-d8a8cdfd0343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:15.323309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-21fe855f-2a52-49c2-a759-d8a8cdfd0343 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:15.324502 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-21fe855f-2a52-49c2-a759-d8a8cdfd0343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:15.332996 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:15:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:15.665417 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf62a4-2956-4743-a40d-9146a290d1ae None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:15.676162 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf62a4-2956-4743-a40d-9146a290d1ae None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:15.679824 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:15.680418 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:15.680692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:15.680961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:15.690606 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:15.691953 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99882992-5f80-4f4c-ae81-917e0995f55c service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:15.701139 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 535/1087] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:25.318792 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=29 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:25.697181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=32 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:15:41.024193 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827c0e-b291-4291-8709-23f9b9bbef0d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:41.024755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827c0e-b291-4291-8709-23f9b9bbef0d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:41.024755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76827c0e-b291-4291-8709-23f9b9bbef0d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:41.026128 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 553/1088] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:41.031403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aead-ee79-45f2-a90d-c3ad85ba6e93 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:41.031888 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aead-ee79-45f2-a90d-c3ad85ba6e93 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:41.032610 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aead-ee79-45f2-a90d-c3ad85ba6e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:41.052449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-e3b1aead-ee79-45f2-a90d-c3ad85ba6e93 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:41.053649 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-e3b1aead-ee79-45f2-a90d-c3ad85ba6e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:41.062280 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 536/1089] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:41.432295 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f043c5-2f50-4d08-902f-638b95ac2a4e None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:41.432574 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f043c5-2f50-4d08-902f-638b95ac2a4e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:41.432847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f043c5-2f50-4d08-902f-638b95ac2a4e None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:41.434165 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 554/1090] 10.222.0.25 () {54 vars in 966 bytes} [Fri Sep 9 11:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:41.439754 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f49cf-c82a-4f60-b217-13f876928e26 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:41.440042 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f49cf-c82a-4f60-b217-13f876928e26 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:41.440316 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f49cf-c82a-4f60-b217-13f876928e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:41.461278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-385f49cf-c82a-4f60-b217-13f876928e26 None None] MFA Rules not processed for user `17bcafde41734dbe8c9a400aa9bbf802`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:41.462503 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-385f49cf-c82a-4f60-b217-13f876928e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:41.469039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 537/1091] 10.222.0.25 () {58 vars in 1063 bytes} [Fri Sep 9 11:15:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:41.477530 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f043c5-2f50-4d08-902f-638b95ac2a4e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:41.489618 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f043c5-2f50-4d08-902f-638b95ac2a4e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:41.493437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bcafde41734dbe8c9a400aa9bbf802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:41.494086 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:41.494374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:41.494657 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:41.505392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:41.506896 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea0a64-a56c-470f-977e-d0ef19e25410 service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:41.518099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 555/1092] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:44.054818 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac8b5-7ba0-480c-b682-0dee2cbaf6b0 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:44.055415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac8b5-7ba0-480c-b682-0dee2cbaf6b0 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:44.055415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac8b5-7ba0-480c-b682-0dee2cbaf6b0 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:44.056696 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 538/1093] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:44.062643 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44890245-1fa1-4496-97fc-d3e1bab20641 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:44.063920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44890245-1fa1-4496-97fc-d3e1bab20641 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:44.063920 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44890245-1fa1-4496-97fc-d3e1bab20641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:44.083893 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-44890245-1fa1-4496-97fc-d3e1bab20641 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:44.085100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-44890245-1fa1-4496-97fc-d3e1bab20641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:44.093054 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 556/1094] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:44.423918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ac8b5-7ba0-480c-b682-0dee2cbaf6b0 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:44.437954 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ac8b5-7ba0-480c-b682-0dee2cbaf6b0 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:44.443016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:44.443619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:44.443889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:44.444150 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:44.444792 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:44.446603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:15:44.446603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:15:44.446603 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:15:44.447761 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecc8a8-6a00-49b3-a47d-60300657949b admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:44.467135 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 539/1095] 10.222.0.25 () {56 vars in 1108 bytes} [Fri Sep 9 11:15:44 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:15:46.959371 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3d04-d8a4-4bd8-8561-f596f8d93aab None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:46.959934 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3d04-d8a4-4bd8-8561-f596f8d93aab None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:46.960048 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f3d04-d8a4-4bd8-8561-f596f8d93aab None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:46.961482 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 557/1096] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:46.967198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abae4f-1fcf-45b0-9a90-dc6e8b8d66e8 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:46.967636 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abae4f-1fcf-45b0-9a90-dc6e8b8d66e8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:46.967762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abae4f-1fcf-45b0-9a90-dc6e8b8d66e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:46.988151 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-49abae4f-1fcf-45b0-9a90-dc6e8b8d66e8 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:46.990510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-49abae4f-1fcf-45b0-9a90-dc6e8b8d66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:47.007479 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 540/1097] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:47.363304 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f3d04-d8a4-4bd8-8561-f596f8d93aab None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:47.377103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f3d04-d8a4-4bd8-8561-f596f8d93aab None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:47.382130 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:47.382761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:47.383029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:47.383289 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:47.392030 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:47.393578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2a59-cddc-4bc5-a48f-f99452b6b4e6 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:47.403028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 558/1098] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:50.086957 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6212b-83af-43fc-9b1c-ab2815167f31 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:50.087558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6212b-83af-43fc-9b1c-ab2815167f31 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:50.087558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6212b-83af-43fc-9b1c-ab2815167f31 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:50.088816 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 541/1099] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:50.094803 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d31d8-1dc1-4423-bc0c-a85808c3a230 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:50.095321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d31d8-1dc1-4423-bc0c-a85808c3a230 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:50.095321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d31d8-1dc1-4423-bc0c-a85808c3a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:50.126730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-374d31d8-1dc1-4423-bc0c-a85808c3a230 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:50.127949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-374d31d8-1dc1-4423-bc0c-a85808c3a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:50.137326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 559/1100] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:15:50.488050 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6212b-83af-43fc-9b1c-ab2815167f31 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:50.500842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6212b-83af-43fc-9b1c-ab2815167f31 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:50.504738 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:50.505536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:50.505904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:50.506285 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:50.519433 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:50.521076 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5bcad-4be6-41b9-a76e-1bcea1b316ec service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:50.531350 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 542/1101] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:53.027015 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f924d2-1d49-4bea-9c74-55293640a7a6 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:53.027548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f924d2-1d49-4bea-9c74-55293640a7a6 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:53.027548 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f924d2-1d49-4bea-9c74-55293640a7a6 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:53.028943 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 560/1102] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:53.034065 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82db00-aa21-47b8-b036-de5d2170a501 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:53.034566 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82db00-aa21-47b8-b036-de5d2170a501 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:53.034708 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82db00-aa21-47b8-b036-de5d2170a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:53.053905 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-6f82db00-aa21-47b8-b036-de5d2170a501 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:53.055110 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-6f82db00-aa21-47b8-b036-de5d2170a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:53.062901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 543/1103] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:53.407307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f924d2-1d49-4bea-9c74-55293640a7a6 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:53.417784 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f924d2-1d49-4bea-9c74-55293640a7a6 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:53.421292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:53.421876 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:53.422148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:53.422456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:53.431445 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:53.432900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb69279-aa35-470b-a4f9-92cf275843fe service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:53.443350 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 561/1104] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:56.010724 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf47e1-a2ee-46a6-af00-c69bd6e211d8 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:56.011298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf47e1-a2ee-46a6-af00-c69bd6e211d8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:56.011298 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf47e1-a2ee-46a6-af00-c69bd6e211d8 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:56.012582 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 544/1105] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:56.018745 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69644-584b-4573-8a01-644e98f13083 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:56.019476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69644-584b-4573-8a01-644e98f13083 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:56.019476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69644-584b-4573-8a01-644e98f13083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:56.039386 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-cad69644-584b-4573-8a01-644e98f13083 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:56.040588 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-cad69644-584b-4573-8a01-644e98f13083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:56.048363 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 562/1106] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:56.397368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf47e1-a2ee-46a6-af00-c69bd6e211d8 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:56.408709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf47e1-a2ee-46a6-af00-c69bd6e211d8 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:56.412380 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:56.412980 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:56.413251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:56.413517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:56.422961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:56.424388 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6a816-c229-4926-886a-2bfd1287b524 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:56.434243 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 545/1107] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:15:59.059942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f206-b8d9-4acc-aeb8-843c7acbe119 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:59.060517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f206-b8d9-4acc-aeb8-843c7acbe119 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:59.060517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669f206-b8d9-4acc-aeb8-843c7acbe119 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:59.061812 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 563/1108] 10.222.0.25 () {54 vars in 927 bytes} [Fri Sep 9 11:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:15:59.067563 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0572b14-f10f-4edd-bb92-b856fcdfca56 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:59.068189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0572b14-f10f-4edd-bb92-b856fcdfca56 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:59.068189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0572b14-f10f-4edd-bb92-b856fcdfca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:59.088292 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f0572b14-f10f-4edd-bb92-b856fcdfca56 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:15:59.089474 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f0572b14-f10f-4edd-bb92-b856fcdfca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:15:59.097757 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 546/1109] 10.222.0.25 () {58 vars in 1024 bytes} [Fri Sep 9 11:15:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:15:59.438633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669f206-b8d9-4acc-aeb8-843c7acbe119 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:15:59.449699 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669f206-b8d9-4acc-aeb8-843c7acbe119 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:15:59.454189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:15:59.454818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:15:59.455095 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:15:59.455363 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:15:59.464610 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:15:59.466011 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67983e99-b234-4136-90bd-a179adce09e4 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:15:59.475390 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 564/1110] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:15:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:16:09.083788 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=33 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:16:09.471311 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=33 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:16.817484 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:16.818215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:16.818215 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:16.894860 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:16.896095 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:16.943082 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 547/1111] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:17:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:17:16.953321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:16.954068 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:16.954224 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:16.978383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:16.979619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:16.989619 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 565/1112] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:17:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:17:16.994546 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.005668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d14dd-77d4-46fe-8cce-95cd07d3b3cc None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.010850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.011467 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.011751 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.012025 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.012777 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:17:17.013200 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.014182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.014182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:17:17.014182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:17:17.015130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.028889 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 548/1113] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 9 11:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:17:17.042512 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.058525 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311f24-9e26-498a-ac7f-56d4f0670a01 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.066250 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.067260 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.067753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.068160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.069264 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.072280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.072280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:17:17.072280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:17:17.074217 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.118099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 566/1114] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 9 11:17:17 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:17:17.125258 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.142109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b1b53-14d6-48fb-a75a-f3934d477c25 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.239492 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.240509 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.240952 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.241429 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.242607 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.244336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.244336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:17:17.244336 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:17:17.246575 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.279035 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 549/1115] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:17:17 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:17:17.283863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.295375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e0fc-45f2-4cef-8c8b-570b2c79019b admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.300105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.300725 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.301005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.301278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.301925 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.302982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.302982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:17:17.302982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:17:17.303880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.318899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 567/1116] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:17:17.324312 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.335918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb70d4-357b-475f-a14a-33240f53316a admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.340633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.341301 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.341578 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.341875 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.342551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.343558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.343558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:17:17.343558 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:17:17.344474 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f14c48-985e-4ac0-b340-3bd86db1c62f admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.358877 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 550/1117] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:17:17.363753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.375000 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9ae9-bfba-4c69-906d-0f61736eab22 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.380292 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.381007 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.381467 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.381894 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] PATH_INFO: `/v3/projects/ff4d7bbbdc484644a4f12667d45858bd/users/f32d96bafcb142e4a70f8ffa82cb1c78/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.400413 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4d7bbbdc484644a4f12667d45858bd, user_id=f32d96bafcb142e4a70f8ffa82cb1c78, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.401449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.401449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:17:17.401449 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:17:17.403552 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934b1b0-f442-473b-89ca-2da5defd0c2d admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.418985 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 568/1118] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:17:17 2022] PUT /identity/v3/projects/ff4d7bbbdc484644a4f12667d45858bd/users/f32d96bafcb142e4a70f8ffa82cb1c78/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:17:17.440570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d59d-daa5-4efc-8fea-9c52cd61ebcd None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.441181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d59d-daa5-4efc-8fea-9c52cd61ebcd None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.441683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87d59d-daa5-4efc-8fea-9c52cd61ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.478134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-df87d59d-daa5-4efc-8fea-9c52cd61ebcd None None] MFA Rules not processed for user `f32d96bafcb142e4a70f8ffa82cb1c78`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:17.479439 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-df87d59d-daa5-4efc-8fea-9c52cd61ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:17.515804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:17.551311 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 551/1119] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:17:17 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:17:17.566016 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b52-d380-4b83-ab63-6b8e92da90c9 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.567217 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b52-d380-4b83-ab63-6b8e92da90c9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.568244 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5b52-d380-4b83-ab63-6b8e92da90c9 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.570105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 569/1120] 10.222.0.25 () {54 vars in 964 bytes} [Fri Sep 9 11:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:17:17.575975 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c3d6-95be-44b6-9368-821e5e639fc4 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.576353 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c3d6-95be-44b6-9368-821e5e639fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.576673 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c3d6-95be-44b6-9368-821e5e639fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.609346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-d462c3d6-95be-44b6-9368-821e5e639fc4 None None] MFA Rules not processed for user `397af280379f4d7c87ffad8b19d76100`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:17.610719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d462c3d6-95be-44b6-9368-821e5e639fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:17.693670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 552/1121] 10.222.0.25 () {58 vars in 1061 bytes} [Fri Sep 9 11:17:17 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:17:17.702675 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5b52-d380-4b83-ab63-6b8e92da90c9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.714265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5b52-d380-4b83-ab63-6b8e92da90c9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.718759 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397af280379f4d7c87ffad8b19d76100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.719368 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.719645 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.719916 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.729321 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.730839 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.741670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 570/1122] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:17:17 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:17:17.791466 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c65b3-df5f-4ddf-b894-59e8475a54e8 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.791810 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c65b3-df5f-4ddf-b894-59e8475a54e8 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.792230 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c65b3-df5f-4ddf-b894-59e8475a54e8 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.793675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 553/1123] 10.222.0.25 () {52 vars in 830 bytes} [Fri Sep 9 11:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:17:17.798578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:17.866679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84f6a6-c66d-467b-854b-a59e5c3b9eea service cinder] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:17.871326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:17.872120 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:17.872405 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:17.872683 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] PATH_INFO: `/v3/users/f32d96bafcb142e4a70f8ffa82cb1c78` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:17.873849 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32d96bafcb142e4a70f8ffa82cb1c78)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:17.874907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:17.874907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:17:17.874907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:17:17.876108 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:17.951417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32d96bafcb142e4a70f8ffa82cb1c78'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:17.952404 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32d96bafcb142e4a70f8ffa82cb1c78'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:17.963591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32d96bafcb142e4a70f8ffa82cb1c78'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:17.981440 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32d96bafcb142e4a70f8ffa82cb1c78'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.007484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:18.011711 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32d96bafcb142e4a70f8ffa82cb1c78'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.021178 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 571/1124] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 9 11:17:17 2022] DELETE /identity/v3/users/f32d96bafcb142e4a70f8ffa82cb1c78 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:17:18.025923 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:18.026528 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:18.026528 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:18.046779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:17:18.048006 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:18.113210 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 554/1125] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:17:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:17:18.124406 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:18.125995 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:18.189416 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161a514-551a-482c-a370-f11dafa39550 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:18.193257 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:18.193874 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:18.194151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:18.194463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:18.205160 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:18.206636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15e421-2a3b-4477-b66c-b9b034272961 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:18.216965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 572/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:17:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:17:18.613998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:17:18.615470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:17:18.628247 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56cac-3750-4db4-9a87-09b66aadc758 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:17:18.632782 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:17:18.633415 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:17:18.633688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:17:18.634067 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] PATH_INFO: `/v3/projects/ff4d7bbbdc484644a4f12667d45858bd` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:17:18.635136 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4d7bbbdc484644a4f12667d45858bd)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:17:18.636375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:17:18.636375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:17:18.636375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:17:18.637510 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:17:18.729901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4d7bbbdc484644a4f12667d45858bd', 'request_id': 'req-a2d359d0-f9b0-46e3-a931-0a80df7c39af'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.740568 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:18.745850 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4d7bbbdc484644a4f12667d45858bd', 'request_id': 'req-a2d359d0-f9b0-46e3-a931-0a80df7c39af'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.756078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4d7bbbdc484644a4f12667d45858bd', 'request_id': 'req-a2d359d0-f9b0-46e3-a931-0a80df7c39af'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.777550 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] The token cache is being invalidate because project ff4d7bbbdc484644a4f12667d45858bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:17:18.777934 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.779152 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-a2d359d0-f9b0-46e3-a931-0a80df7c39af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:17:18.780795 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 555/1127] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 9 11:17:18 2022] DELETE /identity/v3/projects/ff4d7bbbdc484644a4f12667d45858bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:17:28.212326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:17:28.772473 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:44.748155 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.748729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.748729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.749987 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:18:44.755508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70544-cf62-4d29-8feb-d18446e1f009 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:44.756080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70544-cf62-4d29-8feb-d18446e1f009 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:44.756080 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70544-cf62-4d29-8feb-d18446e1f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:44.775971 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c1d70544-cf62-4d29-8feb-d18446e1f009 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:44.777181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c1d70544-cf62-4d29-8feb-d18446e1f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:44.835560 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:18:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:44.996005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:44.997726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:45.082858 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544224-dd6e-4218-a8c0-02fd68c36268 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:45.088500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:45.089104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:45.089380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:45.089656 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:45.097815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:45.099426 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d2790-00fa-4c77-abdc-c03a0b51d56d service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:45.108713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 574/1130] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:46.786922 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f1de-a78b-4bf7-b902-b4812145e769 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:46.787455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f1de-a78b-4bf7-b902-b4812145e769 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:46.787455 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7f1de-a78b-4bf7-b902-b4812145e769 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:46.788719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:46.794008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181dc-98f7-4121-9510-46762bbac784 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:46.794463 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181dc-98f7-4121-9510-46762bbac784 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:46.794583 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596181dc-98f7-4121-9510-46762bbac784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:46.813470 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-596181dc-98f7-4121-9510-46762bbac784 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:46.814693 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-596181dc-98f7-4121-9510-46762bbac784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:46.822376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:18:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:46.989835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7f1de-a78b-4bf7-b902-b4812145e769 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:47.004070 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7f1de-a78b-4bf7-b902-b4812145e769 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:47.008986 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:47.009609 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:47.009884 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:47.010155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:47.018416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:47.019982 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f79a8-26ae-4c0a-acb7-67f68fe75fef service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:47.029925 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 558/1133] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:50.412702 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c510-2075-402a-b75d-70dd9e59322d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:50.413284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c510-2075-402a-b75d-70dd9e59322d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:50.413284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c510-2075-402a-b75d-70dd9e59322d None None] PATH_INFO: `/v3` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:50.415057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 576/1134] 10.222.0.42 () {54 vars in 925 bytes} [Fri Sep 9 11:18:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 11:18:50.421622 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453b9d-f141-4544-acfa-acad2879dd6e None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:50.422064 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453b9d-f141-4544-acfa-acad2879dd6e None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:50.422160 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453b9d-f141-4544-acfa-acad2879dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:50.443911 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-55453b9d-f141-4544-acfa-acad2879dd6e None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:50.445120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-55453b9d-f141-4544-acfa-acad2879dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:50.512267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 559/1135] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Sep 9 11:18:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:56.808342 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=40 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:18:59.047443 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5f34-7a9e-4a94-b96a-9ad3574df718 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.048055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5f34-7a9e-4a94-b96a-9ad3574df718 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.048055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea5f34-7a9e-4a94-b96a-9ad3574df718 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.049284 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 577/1136] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 9 11:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:59.054802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.055304 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.055416 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.078071 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:59.079540 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:59.088480 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 560/1137] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 9 11:18:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:18:59.091262 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f2a-c5b0-4e82-b7be-91c6660bb1b9 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.091591 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f2a-c5b0-4e82-b7be-91c6660bb1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.091868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd3f2a-c5b0-4e82-b7be-91c6660bb1b9 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.093204 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 578/1138] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:18:59.095949 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:59.097815 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.098096 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.098394 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.106490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d9b4-0e5a-44c3-853d-e93532bd7328 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:59.111499 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:59.112106 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.112382 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.112722 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.117929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:18:59.119143 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:18:59.121901 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:59.123456 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01903ca7-e4fd-430b-ad6b-59e72ccadfa1 service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:59.127129 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 579/1139] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:18:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:18:59.134762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 561/1140] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:18:59.290907 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:18:59.305259 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f330a-8344-4ee0-9ae5-7c617ec872e2 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:18:59.311045 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:18:59.311682 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:18:59.311933 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:18:59.312201 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:18:59.320752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:18:59.322317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cfc0c-c53b-4771-b011-23953521e5f3 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:18:59.331808 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 580/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:18:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:00.978531 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788280-1a2b-4282-a577-a855327cfbe7 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:00.979092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788280-1a2b-4282-a577-a855327cfbe7 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:00.979092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10788280-1a2b-4282-a577-a855327cfbe7 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:00.980435 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 562/1142] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 11:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:00.985780 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82508df-d6e3-4dc8-ac3a-4efd3eb17003 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:00.986323 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82508df-d6e3-4dc8-ac3a-4efd3eb17003 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:00.986323 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82508df-d6e3-4dc8-ac3a-4efd3eb17003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:01.009687 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e82508df-d6e3-4dc8-ac3a-4efd3eb17003 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:01.010955 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e82508df-d6e3-4dc8-ac3a-4efd3eb17003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:01.019035 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 581/1143] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 11:19:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:01.180004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10788280-1a2b-4282-a577-a855327cfbe7 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:01.193306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10788280-1a2b-4282-a577-a855327cfbe7 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:01.199078 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:01.199668 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:01.199942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:01.200211 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:01.208585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:01.210207 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0634fca-573f-4a4b-8947-352944914cbc service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:01.219588 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 563/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:05.923228 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:05.923818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:05.923818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:05.925104 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 582/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:05.930967 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb5d6-a3fb-4170-9e50-62837e83db9d None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:05.931459 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb5d6-a3fb-4170-9e50-62837e83db9d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:05.931570 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fb5d6-a3fb-4170-9e50-62837e83db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:05.951046 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-9f0fb5d6-a3fb-4170-9e50-62837e83db9d None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:05.952274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-9f0fb5d6-a3fb-4170-9e50-62837e83db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:05.960163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 564/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:19:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:06.304973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:06.307121 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:06.377503 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d03c51-9836-4b44-9322-184c365b8601 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:06.381020 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:06.381614 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:06.381888 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:06.382154 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:06.390919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:06.392318 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8003c-f3eb-4738-b3e4-30ddd54696c6 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:06.401934 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 583/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:08.822606 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:08.823221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:08.823221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:08.824716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 565/1148] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:08.830064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0209d-11f8-44d4-992b-098aae28f18a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:08.830555 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0209d-11f8-44d4-992b-098aae28f18a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:08.830668 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0209d-11f8-44d4-992b-098aae28f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:08.850900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4eb0209d-11f8-44d4-992b-098aae28f18a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:08.852105 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4eb0209d-11f8-44d4-992b-098aae28f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:08.859900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 584/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:19:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:09.201413 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:09.203144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:09.214585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=81 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:09.220988 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbbe73-781d-4183-98dc-bc1d3c3caf03 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:09.224504 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:09.225591 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:09.225866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:09.226128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:09.239386 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:09.241625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bec6b-a2cc-465d-8e1f-740d60e8c1f5 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:09.251709 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 566/1150] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:13.484383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:13.484979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:13.484979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:13.486468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 585/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:13.492586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea28b-c45b-4865-a2c9-3d27b49bee96 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:13.493134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea28b-c45b-4865-a2c9-3d27b49bee96 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:13.493134 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ea28b-c45b-4865-a2c9-3d27b49bee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:13.513284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-571ea28b-c45b-4865-a2c9-3d27b49bee96 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:13.514515 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-571ea28b-c45b-4865-a2c9-3d27b49bee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:13.523015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 567/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:19:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:13.881723 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:13.883466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:13.951593 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588baec-bc48-48dd-b264-9b37a9589434 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:13.955239 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397af280379f4d7c87ffad8b19d76100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:13.955845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:13.956123 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:13.956395 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:13.965456 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:13.966942 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ceca69-8039-41c5-a256-a0ce4b1f2a4a service cinder] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:13.976296 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 586/1153] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:16.383895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:16.383895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:16.384774 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:16.385309 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 568/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 11:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:19:16.390731 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9445d-69bc-4d45-87ba-1a2f4ec03766 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:16.391153 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9445d-69bc-4d45-87ba-1a2f4ec03766 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:16.391275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9445d-69bc-4d45-87ba-1a2f4ec03766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:16.411331 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-93a9445d-69bc-4d45-87ba-1a2f4ec03766 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:19:16.412622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-93a9445d-69bc-4d45-87ba-1a2f4ec03766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:16.420417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 587/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 11:19:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:19:16.769322 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:19:16.771063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:19:16.784531 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4e0f-8aa8-4c23-a500-b4f2b477c538 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:19:16.788617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397af280379f4d7c87ffad8b19d76100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:19:16.789198 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:19:16.789469 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:19:16.789734 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:19:16.799928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:19:16.801343 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34219d21-6cdb-40cd-ba1e-d9e45d422761 service cinder] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:19:16.810843 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 569/1156] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:19:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:19:26.406471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=80 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:19:26.806811 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=14 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:33.397524 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43e818-d401-48f3-bd46-94433f5880b5 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.398189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43e818-d401-48f3-bd46-94433f5880b5 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.398189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43e818-d401-48f3-bd46-94433f5880b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.418015 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56b25-df76-4562-8a52-ba554f0763b1 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.418617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56b25-df76-4562-8a52-ba554f0763b1 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.418617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b56b25-df76-4562-8a52-ba554f0763b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.421309 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-ba43e818-d401-48f3-bd46-94433f5880b5 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.422730 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-ba43e818-d401-48f3-bd46-94433f5880b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.431280 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 588/1157] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:33.439884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.440169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.440446 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.440569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-04b56b25-df76-4562-8a52-ba554f0763b1 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.441802 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-04b56b25-df76-4562-8a52-ba554f0763b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.450115 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 570/1158] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:20:33.458994 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.459278 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.459553 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.461658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.462880 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.471252 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 589/1159] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:20:33.475832 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.479992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.481188 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.484913 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593201d-6aeb-487f-a77d-0d528a9dce2e None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.489192 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 571/1160] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:20:33.492872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.492872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.492872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.492872 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.493267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:20:33.493267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.493267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:20:33.493267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:20:33.493267 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:20:33.493702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.494057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.502702 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6df4d-2f77-4b13-85f0-aec60c84c58f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.509962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 590/1161] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:20:33.510131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.510131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.510131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.510131 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.510576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 11:20:33.510576 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.511295 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.515182 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.526848 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 572/1162] 10.222.0.25 () {58 vars in 1153 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 11:20:33.527016 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ca449-6c6c-487a-a3e9-56bb8bfb96f5 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.530420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.531063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.531344 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.531637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.531926 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.532315 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.534813 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.542395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88acbc-70ff-46cb-a16d-985cd8a6bfd9 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.547019 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.547619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.547895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.548206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.548832 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.549837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:20:33.549837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:20:33.549837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:20:33.551111 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.566867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 591/1163] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:20:33.567897 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.580633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 573/1164] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:33.584756 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.634726 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2ba91-49b2-4d75-a6a1-9242c87d83e5 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.648074 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1301-99f9-4ccc-8eaf-c5a6e38a8576 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.654228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.654926 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.655284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.655486 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.656119 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.658662 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.683036 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 574/1165] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 11:20:33.687149 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.697504 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.698638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.698638 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.698821 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7834b-c163-4c8d-a89a-b69de767f539 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.698918 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.699330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.700319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:20:33.700319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:20:33.700319 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:20:33.701553 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.704130 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.705235 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.705513 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.705783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.706517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.708156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.723961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 575/1166] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:20:33.726297 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 592/1167] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:33.730395 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.730529 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.741346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19def35-72b2-44da-8ebc-2fcf1f83aa70 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.741577 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be257e-34d2-41ca-aa76-d2d6f8baabfe admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.746057 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.746204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.746679 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.746812 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.746954 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.747051 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.747227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.747324 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.747854 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.747959 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.749421 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.749529 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.760118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 593/1168] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:20:33.760846 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 576/1169] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:20:33.764677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.765978 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.774685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b86f7-6b58-42ae-9763-60738959a945 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.775686 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cffce-1974-43a2-94b8-2b3152cd4623 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.779221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.779997 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.780297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.780416 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.780641 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.780940 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.781218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.781326 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.781490 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] PATH_INFO: `/v3/projects/1c31e33702c84797a4a9bc3d51dc2cb4/users/0ba8f6277c75471fa8a73e6077f739e3/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.783633 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.794625 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 594/1170] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:20:33.797392 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c31e33702c84797a4a9bc3d51dc2cb4, user_id=0ba8f6277c75471fa8a73e6077f739e3, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.799092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:20:33.799092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:20:33.799092 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:20:33.799378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.801041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c347b-8d2f-4da0-aa4f-d2a340669dfb admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.809209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020a07-1ccf-4f59-b168-05ca2d044c81 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.814872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 577/1171] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:33 2022] PUT /identity/v3/projects/1c31e33702c84797a4a9bc3d51dc2cb4/users/0ba8f6277c75471fa8a73e6077f739e3/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:20:33.820044 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.820508 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.820837 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.836863 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:33.841297 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.842580 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.871148 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:33.871779 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.872061 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.872341 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] PATH_INFO: `/v3/projects/f48cfae9f26e4c1a8890b66f251838c8/users/34cf38aa137c49b0941fc6e8e0d37ab6/roles/a322b06c2e78439baafe5ece304846a2` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.887852 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48cfae9f26e4c1a8890b66f251838c8, user_id=34cf38aa137c49b0941fc6e8e0d37ab6, role_id=a322b06c2e78439baafe5ece304846a2)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:33.890602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc29788-6b37-4ea2-b3ad-6b93c3be72a7 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:33.893344 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:33.904855 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 595/1172] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:33 2022] PUT /identity/v3/projects/f48cfae9f26e4c1a8890b66f251838c8/users/34cf38aa137c49b0941fc6e8e0d37ab6/roles/a322b06c2e78439baafe5ece304846a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:20:33.906927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 578/1173] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:33.910760 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:33.911510 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:33.911510 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:33.917900 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:33.931667 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] MFA Rules not processed for user `53667c405cc947ceb4171bc3579d9405`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:33.932903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:33.974177 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7b3a-b0cc-4f27-8f8b-839c786a0d73 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:33.995005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 596/1174] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:20:34.005042 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:34.028368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:34.029116 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:34.029572 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:34.029823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:34.041657 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:34.043128 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb434fd-5e79-4935-878f-19eac50ae6ee service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:34.058721 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 579/1175] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:20:34.061516 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41a416-a958-40b1-9039-1e06f635c29a None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:34.065349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:34.065965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:34.068235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:34.068235 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:34.076303 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:34.077743 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:34.089718 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 597/1176] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:20:39.138213 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.138827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.138827 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.184099 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:39.185288 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:39.300405 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 580/1177] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:39.301172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.323361 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086eb2f-1916-4938-80cb-0d3f9c03ba44 service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.334360 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.335001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.335452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.335728 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] PATH_INFO: `/v3/projects` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.336517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.338844 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.384974 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 598/1178] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 9 11:20:39 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:39.389045 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.405697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13c05c-7759-4ffd-9c9e-8da85cdb93cc None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.487526 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:39.507249 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.508223 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.508781 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.509341 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.510209 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.512411 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.550568 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.558181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 581/1179] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:20:39 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:39.564868 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c994a5-4a4c-4ea5-959f-730035a2d45f admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.572516 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.577387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.577387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.577387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.577387 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.578892 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.596973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.597505 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 599/1180] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 11:20:39.608704 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45114-8568-44f4-865a-4bde860ff8f7 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.615420 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.616191 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.616536 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.617950 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] PATH_INFO: `/v3/projects/8be5e218543b4aa180c6f6b809fe6f34/users/6a3c198460e947bb87a98105f286bab5/roles/812192d969e9436d9845f219dd311628` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.636517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be5e218543b4aa180c6f6b809fe6f34, user_id=6a3c198460e947bb87a98105f286bab5, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.639056 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.659240 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 582/1181] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:39 2022] PUT /identity/v3/projects/8be5e218543b4aa180c6f6b809fe6f34/users/6a3c198460e947bb87a98105f286bab5/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:20:39.663383 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.684981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687cd59-7d62-45ac-836e-fc8ebd702eed admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.706939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:39.765202 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.765939 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.766273 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.766636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] PATH_INFO: `/v3/roles` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.767417 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.769156 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880036b-50c9-4b7a-93e7-ae6593915892 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.787644 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 600/1182] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:20:39.792581 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:39.809635 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615ee39-ec42-496b-bd1f-07313327fe43 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:39.817551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:39.818865 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:39.819335 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:39.819773 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] PATH_INFO: `/v3/projects/8be5e218543b4aa180c6f6b809fe6f34/users/6a3c198460e947bb87a98105f286bab5/roles/812192d969e9436d9845f219dd311628` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:39.822477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be5e218543b4aa180c6f6b809fe6f34, user_id=6a3c198460e947bb87a98105f286bab5, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:39.827016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:39.851670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 583/1183] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:39 2022] PUT /identity/v3/projects/8be5e218543b4aa180c6f6b809fe6f34/users/6a3c198460e947bb87a98105f286bab5/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:20:40.264500 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:40.264976 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:40.265407 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:40.299468 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] MFA Rules not processed for user `0ba8f6277c75471fa8a73e6077f739e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:40.301124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:40.391209 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 601/1184] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:40 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:40.396031 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:40.481478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e763d-4d64-4027-aa74-ea0e69ab72a4 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:40.488023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:40.489011 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:40.489322 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:40.489876 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:40.490643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:40.493007 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:40.566063 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 584/1185] 10.222.0.25 () {60 vars in 1153 bytes} [Fri Sep 9 11:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:40.569704 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:40.586473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48ce13-e565-4402-aa27-634a6ce0e6f9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:40.708903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:40.709807 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:40.710307 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:40.710454 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] PATH_INFO: `/v3/users` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:40.711038 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:40.713979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:40.748986 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 602/1186] 10.222.0.25 () {60 vars in 1144 bytes} [Fri Sep 9 11:20:40 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 11:20:40.755370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:40.789263 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d8b0-6068-4350-8e93-43790cab1ea1 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:40.812497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:40.816494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:40.816859 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:40.817218 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:40.817979 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:40.819689 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:40.846426 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 585/1187] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:20:40.849821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:40.860639 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3b7e8-d3e2-4cae-8acb-8f33333e9c06 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:40.875479 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:40.876243 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:40.876498 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:40.876755 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] PATH_INFO: `/v3/projects/f915689c1f3a45daa9076e6f3f132c48/users/4e943234e99f40399c7a1b67ab8b87b6/roles/812192d969e9436d9845f219dd311628` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:40.916628 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f915689c1f3a45daa9076e6f3f132c48, user_id=4e943234e99f40399c7a1b67ab8b87b6, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:40.919452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:40.944338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 603/1188] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:40 2022] PUT /identity/v3/projects/f915689c1f3a45daa9076e6f3f132c48/users/4e943234e99f40399c7a1b67ab8b87b6/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:20:40.945783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:40.961262 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67309c-28ca-4559-aa7f-25a798b717c8 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:41.051120 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:41.051919 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:41.052204 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:41.052476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:41.053144 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:41.055033 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0824-873b-450e-877f-a3351bf27a14 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:41.072022 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 586/1189] 10.222.0.25 () {58 vars in 1122 bytes} [Fri Sep 9 11:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 11:20:41.076867 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:41.091308 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3024-0ec7-435b-80dd-cd4bd9c4daa9 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:41.098882 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:41.101208 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] REQUEST_METHOD: `PUT` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:41.101506 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:41.102254 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] PATH_INFO: `/v3/projects/f915689c1f3a45daa9076e6f3f132c48/users/4e943234e99f40399c7a1b67ab8b87b6/roles/812192d969e9436d9845f219dd311628` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:41.106490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f915689c1f3a45daa9076e6f3f132c48, user_id=4e943234e99f40399c7a1b67ab8b87b6, role_id=812192d969e9436d9845f219dd311628)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:41.113352 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:41.121076 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:41.146119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 604/1190] 10.222.0.25 () {60 vars in 1483 bytes} [Fri Sep 9 11:20:41 2022] PUT /identity/v3/projects/f915689c1f3a45daa9076e6f3f132c48/users/4e943234e99f40399c7a1b67ab8b87b6/roles/812192d969e9436d9845f219dd311628 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:20:46.630619 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bd4b-a764-40dd-92eb-1b09aef1a851 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:46.631181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bd4b-a764-40dd-92eb-1b09aef1a851 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:46.631181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bd4b-a764-40dd-92eb-1b09aef1a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:46.659551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:46.701617 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-1d25bd4b-a764-40dd-92eb-1b09aef1a851 None None] MFA Rules not processed for user `6a3c198460e947bb87a98105f286bab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:46.706142 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-1d25bd4b-a764-40dd-92eb-1b09aef1a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:46.809895 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 587/1191] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:46 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:46.825045 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:46.826994 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:46.948063 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8e7c-9d1e-4267-81ee-320130799699 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:46.953471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bcafde41734dbe8c9a400aa9bbf802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:46.954443 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:46.955432 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:46.955961 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:47.092786 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:47.094476 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:47.122246 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 605/1192] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:46 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:20:48.355206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f0d0-ec79-404b-a8d3-83067cb47bf5 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:48.355866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f0d0-ec79-404b-a8d3-83067cb47bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:48.355866 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8f0d0-ec79-404b-a8d3-83067cb47bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:48.424765 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-7bc8f0d0-ec79-404b-a8d3-83067cb47bf5 None None] MFA Rules not processed for user `4e943234e99f40399c7a1b67ab8b87b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:48.427630 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-7bc8f0d0-ec79-404b-a8d3-83067cb47bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:48.536155 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 588/1193] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:48 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:48.549353 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:48.560539 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536249f-2f20-495c-b3a7-63ddd2d0ad40 service glance] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:48.565718 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bcafde41734dbe8c9a400aa9bbf802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:48.567043 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:48.568001 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:48.568349 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:48.653207 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:48.655425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7994-c2c8-43f5-ac82-7aaa3e77c2b3 service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:48.675166 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 606/1194] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:48 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:20:56.802796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aaddf-2afa-4f6c-be0e-b75cefc1c72d None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:56.803643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aaddf-2afa-4f6c-be0e-b75cefc1c72d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:56.803918 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aaddf-2afa-4f6c-be0e-b75cefc1c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:56.826431 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-f10aaddf-2afa-4f6c-be0e-b75cefc1c72d None None] MFA Rules not processed for user `0ba8f6277c75471fa8a73e6077f739e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:56.827643 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-f10aaddf-2afa-4f6c-be0e-b75cefc1c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:56.835585 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 589/1195] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:20:56 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:57.148336 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424747-094b-4d1e-9f15-be70d64a022d None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.148899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424747-094b-4d1e-9f15-be70d64a022d None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.148899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8424747-094b-4d1e-9f15-be70d64a022d None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.151040 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 607/1196] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 9 11:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:20:57.162259 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb8da-1997-4c77-bb61-e99ef3347c46 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.164425 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb8da-1997-4c77-bb61-e99ef3347c46 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.164678 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb8da-1997-4c77-bb61-e99ef3347c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.185712 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-c36bb8da-1997-4c77-bb61-e99ef3347c46 None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:57.188071 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-c36bb8da-1997-4c77-bb61-e99ef3347c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:57.321221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 590/1197] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 9 11:20:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:57.327541 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.327821 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.328099 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.329455 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 608/1198] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 9 11:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:20:57.337470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e3ad4-623b-452b-89e0-791abc7eb04a None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.338023 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e3ad4-623b-452b-89e0-791abc7eb04a None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.338470 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e3ad4-623b-452b-89e0-791abc7eb04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.359156 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=100 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:57.367437 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-db3e3ad4-623b-452b-89e0-791abc7eb04a None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:57.368597 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-db3e3ad4-623b-452b-89e0-791abc7eb04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:57.379261 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 591/1199] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 9 11:20:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:57.394772 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:57.396685 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:57.418241 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c10929-5fc6-4304-a41f-804ff5dbb16b None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:57.422431 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bcafde41734dbe8c9a400aa9bbf802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:57.423047 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.423402 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.424213 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.439409 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:57.440828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff7ceb-4c46-4eec-933f-2b22c5e25c09 service glance] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:57.454660 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 609/1200] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:20:57.838089 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971e88-be17-4fd5-9b0d-a639420a4e37 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.838790 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971e88-be17-4fd5-9b0d-a639420a4e37 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.839383 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971e88-be17-4fd5-9b0d-a639420a4e37 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.841674 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 592/1201] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 9 11:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:20:57.849757 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0bd5-698b-4b1a-9c6e-a78afa3b62de None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.850269 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0bd5-698b-4b1a-9c6e-a78afa3b62de None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.850676 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0bd5-698b-4b1a-9c6e-a78afa3b62de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.873473 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-3b0c0bd5-698b-4b1a-9c6e-a78afa3b62de None None] MFA Rules not processed for user `35c6844418444e628e65ff78e25f5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:57.875058 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-3b0c0bd5-698b-4b1a-9c6e-a78afa3b62de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:57.900492 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=100 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:20:57.956384 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 610/1202] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 9 11:20:57 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:57.968424 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971e88-be17-4fd5-9b0d-a639420a4e37 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:57.981039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29971e88-be17-4fd5-9b0d-a639420a4e37 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:57.986594 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:57.987368 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:57.987639 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:57.987907 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:57.996893 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:57.998407 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:58.011050 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 593/1203] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:57 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:20:58.502886 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:58.503682 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f569-30a7-4fad-aaad-cb19feed1442 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.504513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f569-30a7-4fad-aaad-cb19feed1442 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.504982 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550f569-30a7-4fad-aaad-cb19feed1442 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.506843 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 611/1204] 10.222.0.25 () {54 vars in 962 bytes} [Fri Sep 9 11:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:20:58.516509 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155367-2d51-4433-bee6-b670c797957a None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.516844 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155367-2d51-4433-bee6-b670c797957a None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.517119 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155367-2d51-4433-bee6-b670c797957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.549452 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-f3155367-2d51-4433-bee6-b670c797957a None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:58.551305 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-f3155367-2d51-4433-bee6-b670c797957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:58.561845 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 612/1205] 10.222.0.25 () {58 vars in 1059 bytes} [Fri Sep 9 11:20:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:20:58.567912 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798b1e-67a4-4587-a250-2874926bd996 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.568484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798b1e-67a4-4587-a250-2874926bd996 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.569362 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89798b1e-67a4-4587-a250-2874926bd996 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.571550 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 613/1206] 10.222.0.25 () {54 vars in 912 bytes} [Fri Sep 9 11:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:20:58.577055 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.578752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.579056 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.606929 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:20:58.608616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:58.619517 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 614/1207] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 9 11:20:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:20:58.620333 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69292d-8331-415a-9efb-5bad51c813dc service neutron] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:58.632899 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:20:58.634919 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:58.635551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.635834 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.636117 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.638624 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:20:58.653998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e169c2-d885-44d7-8bda-a18402bd985c None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:20:58.659439 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:20:58.660536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:20:58.660670 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:20:58.661005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:20:58.681518 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:58.682602 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:20:58.683372 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:58.686374 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9388f-192e-4b55-b4b3-57c297e7cb5d service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:20:58.713390 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 615/1209] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:20:58.722330 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 594/1209] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:20:58 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:21:08.691219 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=43 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:08.699268 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=23 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:11.641648 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2460d5-7b51-4c6b-9af5-0aca9fdb142e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:11.642425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2460d5-7b51-4c6b-9af5-0aca9fdb142e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:11.642425 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2460d5-7b51-4c6b-9af5-0aca9fdb142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:11.664185 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-0b2460d5-7b51-4c6b-9af5-0aca9fdb142e None None] MFA Rules not processed for user `35c6844418444e628e65ff78e25f5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:11.665561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-0b2460d5-7b51-4c6b-9af5-0aca9fdb142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:11.673083 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 616/1210] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Sep 9 11:21:11 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:11.684921 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:11.695973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6936ba6-76bb-41ec-9d94-7c047d2b136a service placement] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:11.701928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:11.703449 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:11.703784 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:11.704048 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:11.716136 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:11.718453 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090e862-6c8a-4d3d-9419-cd379e12a6e2 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:11.727140 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 595/1211] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:12.693196 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ac2e-ae28-4940-b9bf-2d86934e334f None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:12.693901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ac2e-ae28-4940-b9bf-2d86934e334f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:12.693901 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0ac2e-ae28-4940-b9bf-2d86934e334f None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:12.695334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 617/1212] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:21:12.749039 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487962d-3f45-4236-aa3e-2c4d24e9a342 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:12.749600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487962d-3f45-4236-aa3e-2c4d24e9a342 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:12.749600 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487962d-3f45-4236-aa3e-2c4d24e9a342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:12.773904 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-3487962d-3f45-4236-aa3e-2c4d24e9a342 None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:12.775168 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-3487962d-3f45-4236-aa3e-2c4d24e9a342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:12.787551 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 596/1213] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:21:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:12.808158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0ac2e-ae28-4940-b9bf-2d86934e334f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:12.826152 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0ac2e-ae28-4940-b9bf-2d86934e334f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:12.832636 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:12.833338 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:12.833691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:12.834031 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:12.843561 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:12.845146 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16309d67-cc46-4ca4-874e-45164b7a16e1 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:12.857064 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 618/1214] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:20.240973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912870-21a8-4005-89af-527ef342873d None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:20.241613 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912870-21a8-4005-89af-527ef342873d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:20.241613 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912870-21a8-4005-89af-527ef342873d None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:20.242890 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 597/1215] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:21:20.254052 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:20.254712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:20.254712 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:20.275565 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:20.276765 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:20.286392 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 619/1216] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:21:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:20.302332 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912870-21a8-4005-89af-527ef342873d None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:20.316461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912870-21a8-4005-89af-527ef342873d None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:20.321675 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:20.322269 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:20.322586 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:20.322856 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:20.342381 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:20.344010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945f35a-13cf-4443-99f3-8df674601cb7 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:20.354273 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 598/1217] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:30.270501 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=12 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:30.350694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=15 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:33.856979 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:33.866976 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094ca7-ffd5-4cec-a808-b5ce9e867afd None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:33.871159 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:33.871771 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:33.872076 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:33.872343 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:33.882073 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:33.883546 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1146e-0f18-4599-82fa-14be3bb166ed service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:33.893378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 620/1218] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:33 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:38.030692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424264-4126-4ec1-a21f-7f4e131049f5 None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:38.031290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424264-4126-4ec1-a21f-7f4e131049f5 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:38.031290 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424264-4126-4ec1-a21f-7f4e131049f5 None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:38.033283 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 599/1219] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:21:38.061671 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca165-58ea-430d-a194-c0f6f3bfd58e None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:38.062691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca165-58ea-430d-a194-c0f6f3bfd58e None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:38.063545 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ca165-58ea-430d-a194-c0f6f3bfd58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:38.090190 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d23ca165-58ea-430d-a194-c0f6f3bfd58e None None] MFA Rules not processed for user `a8460d3ea12e4126b928a51cd29587df`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:38.092875 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d23ca165-58ea-430d-a194-c0f6f3bfd58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:38.103981 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 621/1220] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:21:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:38.246238 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424264-4126-4ec1-a21f-7f4e131049f5 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:21:38.268091 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424264-4126-4ec1-a21f-7f4e131049f5 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:21:38.276633 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:21:38.277596 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:38.278769 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:38.279370 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:38.308318 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:21:38.310302 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2194b8c-3eeb-4cd0-b635-1581682fdf29 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:21:38.325266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 600/1221] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:21:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:21:48.083666 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=9 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:48.318856 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=6 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:21:48.333962 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b06a-ed8e-4e37-9b25-c7432c829a26 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:21:48.334221 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b06a-ed8e-4e37-9b25-c7432c829a26 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:21:48.334604 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7b06a-ed8e-4e37-9b25-c7432c829a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:21:48.354639 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-c5c7b06a-ed8e-4e37-9b25-c7432c829a26 None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:21:48.355828 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-c5c7b06a-ed8e-4e37-9b25-c7432c829a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:21:48.363134 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 622/1222] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:21:48 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:21:58.348373 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:22:14.557936 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:22:14.558432 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:22:14.558517 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:22:14.577026 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:22:14.578206 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:22:14.585402 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 601/1223] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:22:14 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:22:15.009024 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b82f-19df-4864-a3ea-c35071e8ba04 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:22:15.009490 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b82f-19df-4864-a3ea-c35071e8ba04 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:22:15.009596 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b82f-19df-4864-a3ea-c35071e8ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:22:15.029366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-1d50b82f-19df-4864-a3ea-c35071e8ba04 None None] MFA Rules not processed for user `35c6844418444e628e65ff78e25f5d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:22:15.030569 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-1d50b82f-19df-4864-a3ea-c35071e8ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:22:15.036818 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 623/1224] 10.222.0.25 () {58 vars in 1009 bytes} [Fri Sep 9 11:22:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:22:15.047896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:22:15.057137 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe661e25-e4d0-4a4b-868e-0395ba798a79 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:22:15.060692 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:22:15.061284 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:22:15.061555 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:22:15.061820 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:22:15.069358 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:22:15.070804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20b864-c344-4add-95c5-08ea6bf89c90 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:22:15.078724 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 602/1225] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:22:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:22:25.024278 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:22:25.075307 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=9 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:22:31.649428 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:22:31.649903 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:22:31.649998 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:22:31.668322 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:22:31.669496 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:22:31.676261 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 624/1226] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:22:31 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:22:41.663091 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:30.253787 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:30.254287 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:30.254393 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:30.273292 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:23:30.274521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:23:30.281233 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 603/1227] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:23:30 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:23:40.267981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=3 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:23:44.145158 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:23:44.163396 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4534919-d933-4944-a0c3-eddf5fe7931f None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:23:44.167398 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:23:44.167983 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:23:44.168256 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:23:44.168520 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:23:44.177622 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:23:44.179073 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:23:44.188884 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 625/1228] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:23:44 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:23:54.184831 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=10 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:24:53.704186 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:24:53.731343 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b92df-10dd-48df-81e3-0eecec254166 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:24:53.739984 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:24:53.740999 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:24:53.742038 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:24:53.742562 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:24:53.759132 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:24:53.762264 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02afb3-2a70-4f96-9c5a-e7b5bac99c0c service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:24:53.781182 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 604/1229] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:24:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:25:03.773398 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=10 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:25:51.149713 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:51.172751 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0f20-b58b-4fef-a405-62911662c791 service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:51.177953 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:51.179189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:51.179469 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:51.179738 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:51.189931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:51.191894 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:51.203931 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 626/1230] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:51 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:25:56.323004 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:56.323593 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:56.323688 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:56.347406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:25:56.348670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:25:56.355886 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 605/1231] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:25:56 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 11:25:57.179753 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:57.191092 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8afd79-0cf2-44e8-846f-aa10f599730f service nova] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:57.194973 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:57.195495 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:57.195691 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:57.196037 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:57.207312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:57.208752 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:57.221769 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 627/1232] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:25:58.341677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:25:58.352927 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0b73-685a-467b-ae44-c576dffdff63 None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:25:58.357066 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:25:58.357450 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:25:58.357725 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:25:58.357992 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:25:58.371493 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:25:58.374037 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:25:58.389574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 606/1233] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:25:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:07.215110 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=16 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:08.381446 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=9 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:10.887313 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:10.898197 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975ea63-f1d2-42d6-9dca-a17bf261ecdb service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:10.903681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79629e5-c554-4120-abee-19418e237092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:10.904306 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79629e5-c554-4120-abee-19418e237092 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:10.904578 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79629e5-c554-4120-abee-19418e237092 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:10.904847 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79629e5-c554-4120-abee-19418e237092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:10.914169 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79629e5-c554-4120-abee-19418e237092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:10.915811 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79629e5-c554-4120-abee-19418e237092 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:10.926227 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 628/1234] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:10 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:12.215274 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:12.224670 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e7433-318c-4f1f-8557-661993731b42 service neutron] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:12.228750 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:12.229477 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:12.229823 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:12.230166 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:12.238421 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:12.239986 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72d4c3-81a6-4e44-b8f2-b2b6cbf8e544 service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:12.248928 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 607/1235] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:12 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:13.372411 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79629e5-c554-4120-abee-19418e237092 service nova] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:13.389164 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79629e5-c554-4120-abee-19418e237092 service nova] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:13.395074 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:13.396822 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:13.397103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:13.397376 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:13.411018 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:13.413238 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930ed6-c95a-4b2b-970a-72d8cdf01e36 service nova] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:13.426748 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 629/1236] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:22.245175 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=6 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:23.422447 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=12 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:27.756061 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca505a-6812-474c-9469-8d9b598cf9d4 None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:27.756835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca505a-6812-474c-9469-8d9b598cf9d4 None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:27.757016 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca505a-6812-474c-9469-8d9b598cf9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:27.784148 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-41ca505a-6812-474c-9469-8d9b598cf9d4 None None] MFA Rules not processed for user `0ba8f6277c75471fa8a73e6077f739e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:27.785537 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-41ca505a-6812-474c-9469-8d9b598cf9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:27.794697 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 608/1237] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:26:27 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:26:28.441420 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d38fc-282f-44bb-b4f6-f55458ab7ae3 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.446192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d38fc-282f-44bb-b4f6-f55458ab7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.446862 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d38fc-282f-44bb-b4f6-f55458ab7ae3 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.448762 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 630/1238] 10.222.0.25 () {54 vars in 961 bytes} [Fri Sep 9 11:26:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 11:26:28.459683 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.460296 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.460861 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.532835 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:26:28.534255 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:26:28.544027 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 609/1239] 10.222.0.25 () {58 vars in 1058 bytes} [Fri Sep 9 11:26:28 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:26:28.551877 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d38fc-282f-44bb-b4f6-f55458ab7ae3 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:28.565959 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d38fc-282f-44bb-b4f6-f55458ab7ae3 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:28.572189 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:28.573036 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:28.573317 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:28.573616 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:28.589900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:28.592944 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:28.609848 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 631/1240] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:26:38.529124 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=16 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:38.606801 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=6 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:26:46.110681 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:46.123804 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1f45b-14dc-4105-ac53-9810c83f416f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:46.131855 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:46.132836 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:46.133313 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:46.133644 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:46.143809 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:46.146010 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:46.157762 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 610/1241] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:46 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:26:55.350965 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:26:55.363172 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19581e2-db4f-4b49-9fda-4a0db5360f78 service placement] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:26:55.368334 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:26:55.369026 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:26:55.369484 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:26:55.369761 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:26:55.381005 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:26:55.382600 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59269494-b93c-4fe6-a460-1ee04b88434a service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:26:55.393661 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 632/1242] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:26:55 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 11:26:56.152397 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=6 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:00.208687 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:00.249719 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df62cb-3c93-44d1-9da2-f01dfe19b5d7 service nova] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:00.258325 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8460d3ea12e4126b928a51cd29587df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:00.259714 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:00.260018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:00.260331 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:00.272716 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:00.275406 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:00.289872 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 611/1243] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:27:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:27:05.388658 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=6 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:10.285693 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=6 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:27:53.908674 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:53.909258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:53.909258 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:53.937393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] MFA Rules not processed for user `34cf38aa137c49b0941fc6e8e0d37ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:27:53.938631 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:27:53.966437 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 633/1244] 10.222.0.25 () {58 vars in 958 bytes} [Fri Sep 9 11:27:53 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:27:54.309752 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:27:54.329838 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac41329-9245-4b96-b319-75a7e1116f5e service nova] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:27:54.333403 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:27:54.333997 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:27:54.334267 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:27:54.335109 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:27:54.342672 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:27:54.344086 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6657d8-f573-48e8-9e49-1e8fa641d8aa service neutron] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:27:54.352553 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 612/1245] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:27:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:28:03.964028 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=15 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:28:04.348478 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=11 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:27.089183 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:27.090866 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:27.126377 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806d9ca-366c-40f5-b163-662c9c2cb3a9 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:27.129900 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:27.130566 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:27.130844 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:27.131114 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:27.206407 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:27.207829 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e613-554d-4c6f-964a-d57f2629b356 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:27.226941 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 634/1246] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:29:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:29:30.736011 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6cdd-7dff-44be-a905-bb0bd039623d None None] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.736579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6cdd-7dff-44be-a905-bb0bd039623d None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.736579 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d6cdd-7dff-44be-a905-bb0bd039623d None None] PATH_INFO: `/` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.737854 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 613/1247] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:30.750445 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4cc8-d9c2-42cf-9048-cecb27effecc None None] REQUEST_METHOD: `POST` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.750977 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4cc8-d9c2-42cf-9048-cecb27effecc None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.750977 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4cc8-d9c2-42cf-9048-cecb27effecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.791999 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.auth.core [None req-6c6b4cc8-d9c2-42cf-9048-cecb27effecc None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:30.792471 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-6c6b4cc8-d9c2-42cf-9048-cecb27effecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:30.802499 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 635/1248] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:29:30 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:29:30.826783 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d6cdd-7dff-44be-a905-bb0bd039623d None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:30.841998 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d6cdd-7dff-44be-a905-bb0bd039623d None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:30.847741 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:30.848497 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:30.849454 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:30.849727 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:30.858735 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:30.860326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fb412-6cc0-4590-a084-3b2f81785de1 service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:30.870266 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 614/1249] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:29:30 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:29:34.044021 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0991db-01d3-4669-952b-0462d191c381 None None] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.044570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0991db-01d3-4669-952b-0462d191c381 None None] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.044570 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0991db-01d3-4669-952b-0462d191c381 None None] PATH_INFO: `/` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.045980 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 636/1250] 10.222.0.25 () {54 vars in 921 bytes} [Fri Sep 9 11:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 11:29:34.051505 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] REQUEST_METHOD: `POST` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.052553 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.052929 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.073569 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.auth.core [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] MFA Rules not processed for user `27bab9685c4744bf987e6f857c60a989`. Rule list: `[]` (Enabled: `True`). {{(pid=88293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 11:29:34.074842 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:34.083547 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 615/1251] 10.222.0.25 () {58 vars in 1018 bytes} [Fri Sep 9 11:29:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 11:29:34.100366 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0991db-01d3-4669-952b-0462d191c381 None None] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:34.116536 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0991db-01d3-4669-952b-0462d191c381 None None] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:34.121075 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:34.124700 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:34.125393 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.125677 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.125949 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.133544 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f59b3-0a88-44a2-9f85-26db89b7559f None None] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:34.138625 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:34.139264 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.139444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:34.139566 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.139798 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] PATH_INFO: `/v3/users/0ba8f6277c75471fa8a73e6077f739e3` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.140933 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba8f6277c75471fa8a73e6077f739e3)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:34.141060 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:34.141942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: WARNING py.warnings [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:29:34.141942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: warnings.warn(msg) Sep 09 11:29:34.141942 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: Sep 09 11:29:34.143174 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:34.151910 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 637/1252] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:29:34 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:29:34.209235 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba8f6277c75471fa8a73e6077f739e3'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.209892 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba8f6277c75471fa8a73e6077f739e3'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.217346 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba8f6277c75471fa8a73e6077f739e3'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.231094 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba8f6277c75471fa8a73e6077f739e3'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.250729 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba8f6277c75471fa8a73e6077f739e3'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.257326 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 616/1253] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 9 11:29:34 2022] DELETE /identity/v3/users/0ba8f6277c75471fa8a73e6077f739e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 11:29:34.438990 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:34.453800 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8097454-427f-4a3c-b086-8cc421cbfef6 service placement] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:34.519265 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:34.519887 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.520161 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.520957 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] PATH_INFO: `/v3/projects/1c31e33702c84797a4a9bc3d51dc2cb4` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.522071 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c31e33702c84797a4a9bc3d51dc2cb4)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:34.523100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: WARNING py.warnings [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 11:29:34.523100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: warnings.warn(msg) Sep 09 11:29:34.523100 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: Sep 09 11:29:34.524378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:34.549466 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:34.578118 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c31e33702c84797a4a9bc3d51dc2cb4', 'request_id': 'req-07e6e559-0046-4269-88e1-f4e49018df5c'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.585890 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c31e33702c84797a4a9bc3d51dc2cb4', 'request_id': 'req-07e6e559-0046-4269-88e1-f4e49018df5c'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.591869 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c31e33702c84797a4a9bc3d51dc2cb4', 'request_id': 'req-07e6e559-0046-4269-88e1-f4e49018df5c'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.624968 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] The token cache is being invalidate because project 1c31e33702c84797a4a9bc3d51dc2cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:29:34.625151 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.625758 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.627279 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 638/1254] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 9 11:29:34 2022] DELETE /identity/v3/projects/1c31e33702c84797a4a9bc3d51dc2cb4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:29:34.631394 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:34.633163 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:34.647021 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024cc84-0f1c-4722-80f5-31dd18a9888c admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:34.703344 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:34.703973 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:34.704251 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:34.704521 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] PATH_INFO: `/v3/users/4e943234e99f40399c7a1b67ab8b87b6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:34.705654 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e943234e99f40399c7a1b67ab8b87b6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:34.707629 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:34.752507 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e943234e99f40399c7a1b67ab8b87b6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.753159 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e943234e99f40399c7a1b67ab8b87b6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.760221 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e943234e99f40399c7a1b67ab8b87b6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.761375 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:34.769327 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e943234e99f40399c7a1b67ab8b87b6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.781714 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e943234e99f40399c7a1b67ab8b87b6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:34.787779 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 617/1255] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 9 11:29:34 2022] DELETE /identity/v3/users/4e943234e99f40399c7a1b67ab8b87b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:29:34.970378 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:34.971834 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:34.985513 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6e559-0046-4269-88e1-f4e49018df5c admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:35.044330 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:35.045006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:35.045216 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:35.045483 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] PATH_INFO: `/v3/projects/f915689c1f3a45daa9076e6f3f132c48` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:35.046630 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f915689c1f3a45daa9076e6f3f132c48)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:35.048540 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:35.100008 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f915689c1f3a45daa9076e6f3f132c48', 'request_id': 'req-393d6147-2995-4014-9bf3-55fa8a45e592'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:35.108650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f915689c1f3a45daa9076e6f3f132c48', 'request_id': 'req-393d6147-2995-4014-9bf3-55fa8a45e592'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:35.114573 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f915689c1f3a45daa9076e6f3f132c48', 'request_id': 'req-393d6147-2995-4014-9bf3-55fa8a45e592'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:35.125558 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] The token cache is being invalidate because project f915689c1f3a45daa9076e6f3f132c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:29:35.125826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:35.126514 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:29:35.128312 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 639/1256] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 9 11:29:34 2022] DELETE /identity/v3/projects/f915689c1f3a45daa9076e6f3f132c48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:29:44.784436 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:45.122681 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=71,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:29:57.658188 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:29:57.659728 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:57.739306 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052ec2-2174-4527-b302-c766dc03b899 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:29:57.800694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:29:57.801322 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:29:57.801589 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:29:57.801935 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:29:57.803744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:29:57.815605 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:29:57.817430 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:29:57.830519 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 618/1257] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:29:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:30:07.824595 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=58 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:30:46.000124 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:30:46.001724 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:30:46.074729 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6147-2995-4014-9bf3-55fa8a45e592 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:30:46.080488 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c6844418444e628e65ff78e25f5d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:30:46.082088 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:30:46.082585 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:30:46.083039 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:30:46.085079 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:30:46.151663 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:30:46.153019 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:30:46.162587 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 640/1258] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:30:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:30:53.458018 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:30:53.459516 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:30:53.473961 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50ae20-7344-4a44-967d-efe2baba92f0 service placement] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:30:53.478831 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:30:53.479476 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:30:53.479753 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:30:53.480030 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] PATH_INFO: `/v3/users/34cf38aa137c49b0941fc6e8e0d37ab6` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:30:53.497184 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cf38aa137c49b0941fc6e8e0d37ab6)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:30:53.499164 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:30:53.557758 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cf38aa137c49b0941fc6e8e0d37ab6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:53.558461 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cf38aa137c49b0941fc6e8e0d37ab6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:53.567652 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cf38aa137c49b0941fc6e8e0d37ab6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:53.579008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cf38aa137c49b0941fc6e8e0d37ab6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:53.599103 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cf38aa137c49b0941fc6e8e0d37ab6'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:53.607577 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 619/1259] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 9 11:30:53 2022] DELETE /identity/v3/users/34cf38aa137c49b0941fc6e8e0d37ab6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:30:53.823192 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:30:53.840275 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597badb5-9fd2-4bb1-9233-a4fa4c0c39a1 service neutron] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:30:53.912202 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:30:53.913103 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:30:53.913380 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:30:53.913650 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] PATH_INFO: `/v3/projects/f48cfae9f26e4c1a8890b66f251838c8` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:30:53.926826 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48cfae9f26e4c1a8890b66f251838c8)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:30:53.929870 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:30:53.994864 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:30:53.999355 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48cfae9f26e4c1a8890b66f251838c8', 'request_id': 'req-5cf78df3-659f-4172-b533-09ea546a04e8'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.008041 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48cfae9f26e4c1a8890b66f251838c8', 'request_id': 'req-5cf78df3-659f-4172-b533-09ea546a04e8'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.014618 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48cfae9f26e4c1a8890b66f251838c8', 'request_id': 'req-5cf78df3-659f-4172-b533-09ea546a04e8'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.029462 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] The token cache is being invalidate because project f48cfae9f26e4c1a8890b66f251838c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:30:54.029915 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.030764 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.033029 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 641/1260] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 9 11:30:53 2022] DELETE /identity/v3/projects/f48cfae9f26e4c1a8890b66f251838c8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:30:54.037981 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:30:54.039460 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:30:54.053008 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78e86a-3278-4473-9909-9ff331fcc1b4 admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:30:54.115057 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:30:54.115744 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:30:54.116123 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:30:54.116573 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] PATH_INFO: `/v3/users/6a3c198460e947bb87a98105f286bab5` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:30:54.131699 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3c198460e947bb87a98105f286bab5)` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:30:54.133989 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:30:54.191181 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3c198460e947bb87a98105f286bab5'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.192189 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3c198460e947bb87a98105f286bab5'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.197149 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:30:54.202228 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3c198460e947bb87a98105f286bab5'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.213694 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3c198460e947bb87a98105f286bab5'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.226926 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.notifications [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3c198460e947bb87a98105f286bab5'} {{(pid=88293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.233153 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 620/1261] 10.222.0.25 () {58 vars in 1224 bytes} [Fri Sep 9 11:30:54 2022] DELETE /identity/v3/users/6a3c198460e947bb87a98105f286bab5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:30:54.425938 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Authenticating user token {{(pid=88294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:30:54.428006 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.fernet_utils [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:30:54.443444 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf78df3-659f-4172-b533-09ea546a04e8 admin admin] Validating token access rules against request {{(pid=88294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:30:54.522841 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53667c405cc947ceb4171bc3579d9405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa345ead696a4e8d96d7636f92ce2f5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:30:54.523527 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:30:54.523827 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:30:54.524076 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] PATH_INFO: `/v3/projects/8be5e218543b4aa180c6f6b809fe6f34` {{(pid=88294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:30:54.536647 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be5e218543b4aa180c6f6b809fe6f34)` {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:30:54.538537 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] RBAC: Authorization granted {{(pid=88294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:30:54.596571 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be5e218543b4aa180c6f6b809fe6f34', 'request_id': 'req-6036dad0-0f3b-4c71-8833-9db7b16e60ef'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.606448 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be5e218543b4aa180c6f6b809fe6f34', 'request_id': 'req-6036dad0-0f3b-4c71-8833-9db7b16e60ef'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.613947 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be5e218543b4aa180c6f6b809fe6f34', 'request_id': 'req-6036dad0-0f3b-4c71-8833-9db7b16e60ef'} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.626637 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] The token cache is being invalidate because project 8be5e218543b4aa180c6f6b809fe6f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 11:30:54.626919 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.628299 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG keystone.notifications [None req-6036dad0-0f3b-4c71-8833-9db7b16e60ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 11:30:54.629817 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: [pid: 88294|app: 0|req: 642/1262] 10.222.0.25 () {58 vars in 1233 bytes} [Fri Sep 9 11:30:54 2022] DELETE /identity/v3/projects/8be5e218543b4aa180c6f6b809fe6f34 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 11:31:04.229677 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:31:04.623375 dv-osbrick-856711-1-ceph devstack@keystone.service[88294]: DEBUG dbcounter [-] [88294] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:35:04.768169 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Authenticating user token {{(pid=88293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 11:35:04.769574 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:35:04.858666 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277cf2-672b-4f8b-a802-b4e7e782ca1b admin admin] Validating token access rules against request {{(pid=88293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 11:35:04.915896 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27bab9685c4744bf987e6f857c60a989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80931a631fe5403d82bc5fe8f41af018', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 11:35:04.916494 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] REQUEST_METHOD: `GET` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 11:35:04.916771 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] SCRIPT_NAME: `/identity` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 11:35:04.917041 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 11:35:04.918796 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.fernet_utils [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 11:35:04.929611 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 11:35:04.931240 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282d11-cfd2-48ad-a3d8-032106e8bdc2 service placement] RBAC: Authorization granted {{(pid=88293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 11:35:04.940906 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: [pid: 88293|app: 0|req: 621/1263] 10.222.0.25 () {60 vars in 1365 bytes} [Fri Sep 9 11:35:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 11:35:14.936994 dv-osbrick-856711-1-ceph devstack@keystone.service[88293]: DEBUG dbcounter [-] [88293] Writing DB stats keystone:SELECT=67 {{(pid=88293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}